-- Logs begin at Thu 2022-10-06 10:26:02 UTC, end at Thu 2022-10-06 11:29:49 UTC. -- Oct 06 10:55:28.941785 dv-cinder-860209-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 06 10:55:28.949738 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 06 10:55:28.951717 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 10:55:28 2022] *** Oct 06 10:55:28.951717 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 10:55:28.951717 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 10:55:28.951717 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: nodename: dv-cinder-860209-2-iscsi Oct 06 10:55:28.951717 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: machine: x86_64 Oct 06 10:55:28.951717 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: clock source: unix Oct 06 10:55:28.951717 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: pcre jit disabled Oct 06 10:55:28.951717 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: detected number of CPU cores: 4 Oct 06 10:55:28.952294 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: current working directory: / Oct 06 10:55:28.952294 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: detected binary path: /usr/bin/uwsgi-core Oct 06 10:55:28.952294 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: your processes number limit is 47680 Oct 06 10:55:28.952294 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: your memory page size is 4096 bytes Oct 06 10:55:28.952294 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: detected max file descriptor number: 2048 Oct 06 10:55:28.952294 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: lock engine: pthread robust mutexes Oct 06 10:55:28.953501 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: thunder lock: enabled Oct 06 10:55:28.953501 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 06 10:55:28.953501 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 10:55:28.991324 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: Python main interpreter initialized at 0x55a6511f79c0 Oct 06 10:55:28.991324 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: python threads support enabled Oct 06 10:55:28.991324 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: your server socket listen backlog is limited to 100 connections Oct 06 10:55:28.991324 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: your mercy for graceful operations on workers is 90 seconds Oct 06 10:55:28.991712 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 10:55:28.991712 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: *** Operational MODE: preforking *** Oct 06 10:55:28.991982 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: *** uWSGI is running in multiple interpreter mode *** Oct 06 10:55:28.991982 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: spawned uWSGI master process (pid: 105606) Oct 06 10:55:28.992175 dv-cinder-860209-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 06 10:55:28.994481 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: spawned uWSGI worker 1 (pid: 105607, cores: 1) Oct 06 10:55:28.994481 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: spawned uWSGI worker 2 (pid: 105608, cores: 1) Oct 06 10:55:28.994481 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 10:55:29.653782 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 10:55:29.663328 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 10:55:30.744606 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 10:55:30.744606 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: from cryptography.utils import int_from_bytes Oct 06 10:55:30.745181 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 10:55:30.745181 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: from cryptography.utils import int_from_bytes Oct 06 10:55:30.753095 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 10:55:30.753095 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: from cryptography.utils import int_from_bytes Oct 06 10:55:30.753521 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 10:55:30.753521 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: from cryptography.utils import int_from_bytes Oct 06 10:55:33.240493 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 10:55:33.241083 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 10:55:33.241269 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 10:55:33.241631 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 10:55:33.241886 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 10:55:33.242115 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 10:55:33.242502 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.242594 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 10:55:33.242687 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.243475 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.243577 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 10:55:33.243801 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.244132 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 10:55:33.244245 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.244393 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 10:55:33.244489 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.244766 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.244863 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.245082 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.245178 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.245400 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.245490 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.245665 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.245757 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.245980 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.246068 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.246304 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-2-iscsi {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.246390 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.246627 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.246727 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.246934 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.247030 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.247243 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.247334 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.247502 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.247595 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.247814 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.247919 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.248171 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-2-iscsi {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.248268 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.248472 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.248570 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.248783 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.248966 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.249359 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.249495 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.249609 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.249714 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.249823 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.250006 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.250117 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.250307 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.250442 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.250631 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.250825 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.250978 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.251121 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.251242 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.251434 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.251535 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.251736 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.251829 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.252096 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.252208 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.252407 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.252557 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-2-iscsi {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.252712 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.252871 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.253030 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.253183 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.253335 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.253491 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.253653 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.253899 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.253987 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.254207 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.254338 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-2-iscsi {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.254512 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.254650 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.254832 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.254961 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.255170 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.255257 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.255477 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.255668 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.255806 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.256029 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.256151 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.256308 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.256472 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.256624 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.256790 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.256942 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.257091 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.257247 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.257396 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.257570 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.257704 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.257890 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.258022 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.258206 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.258340 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.258636 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.258743 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.258893 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.259191 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.259277 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.259519 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.259611 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.259831 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.259956 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.260174 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.260260 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.260481 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.260566 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.260731 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.260818 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.261023 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.261114 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.261329 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.261425 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.261653 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.261747 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.261959 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.262051 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.262265 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.262373 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.262514 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.262595 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.262755 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.262852 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.263072 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.263159 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.263390 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.263483 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.263696 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.263787 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.264030 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.264125 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.264337 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.264429 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.264648 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.264796 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.264946 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.265102 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.265255 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.265402 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.265709 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.265879 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.265986 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.266250 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.266346 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.266586 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.266834 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.266930 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.267203 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.267401 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.267523 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.267747 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.267872 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.268095 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.268185 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.268426 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.268516 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.268746 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.268834 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.269064 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.269161 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.269378 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.269504 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.269682 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.269774 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.269933 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.270028 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.270234 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.270326 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.270537 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.270631 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.270854 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.270956 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.271162 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.271270 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.271466 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.271565 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.271771 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.271952 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.272083 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.272320 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.272407 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.272659 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.272755 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.272968 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.273056 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.273270 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.273357 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.273612 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.273808 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.273894 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.274233 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.274345 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.274575 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.274814 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.274906 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.275145 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.275238 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.275461 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.275559 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.275773 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.275926 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.276109 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.276195 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.276412 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.276506 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.276719 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.276812 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.277024 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.277109 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.277576 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.277681 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.277886 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.277970 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.278191 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.278283 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.278494 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.278633 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.278801 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.278894 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.279103 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.279187 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.279406 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.279498 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.279714 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.279798 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.280042 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.280130 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.280352 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.280446 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.280652 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.280737 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.280956 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.281041 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.281259 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.281357 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.281562 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.281646 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.281866 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.281951 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.282168 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.282253 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.282468 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.282553 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.282772 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.282857 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.283071 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.283157 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.283370 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.283454 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.283674 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.283759 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.283995 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.284092 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.284311 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.284395 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.284610 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.284695 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.284917 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.285004 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.285221 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.285305 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.285526 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.285620 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.285828 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.285917 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.286131 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.286216 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.286432 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.286525 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.286733 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.286819 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.287035 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.287119 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.287335 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.287427 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.287633 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.287719 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.287953 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.288068 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.288270 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.288368 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.288589 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.288674 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.288895 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.288987 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.289202 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.289289 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.289505 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.289591 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.290400 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.290487 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:55:33.290721 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.291042 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.291134 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.291369 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.291453 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.291684 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.291781 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.292023 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.292110 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.292341 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.292426 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.292651 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.292751 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.292968 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.293081 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.293293 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.293380 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.293610 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.293709 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.293921 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.294007 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.294250 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.294336 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.294562 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.294657 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.294872 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.294958 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.295192 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.295314 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.295511 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.295597 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.295820 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.295933 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.296186 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.296271 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.296504 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.296591 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.296821 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.296907 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.297130 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.297222 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.297445 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.297531 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.297763 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.297857 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.298073 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.298159 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.298381 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.298467 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.298691 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.298776 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.299000 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.299094 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.299310 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.299396 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.299619 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.299706 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.299959 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.300062 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.300287 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.300380 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.300599 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.300691 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.300906 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.301003 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.301220 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.301308 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.301532 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.301631 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.301840 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.301945 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.302148 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.302233 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.302455 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.302541 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.302764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.302927 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.303068 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.303155 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.303371 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.303455 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.303674 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.303761 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.304004 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.304093 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.304308 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.304393 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.304626 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.304714 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.304937 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.305022 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.305248 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.305968 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.306140 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.306324 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.306449 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.306760 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.306847 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.307069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.307164 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.307378 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.307485 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.307683 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.307803 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.308017 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.308147 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.308329 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.308457 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.308634 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.308767 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.308957 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.309075 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.309266 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.309386 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.309570 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.309693 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.309892 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.310012 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.310197 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.310338 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.310511 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.310644 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.310816 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.310977 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.311126 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.311283 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.311436 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.311592 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.311748 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.311926 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.312081 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.312238 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.312402 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.312540 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.312712 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.312837 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.313022 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.313146 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.313355 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.313454 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.313684 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.313769 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.313990 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.314075 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.314315 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.314409 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.314641 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.314726 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.314941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.315026 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.315244 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.315331 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.315548 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.315632 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.315864 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.315969 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.316178 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.316264 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.316481 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.316567 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.316785 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.316877 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.317085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.317170 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.317386 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.317480 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.317687 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.317773 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.317988 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.318075 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.318292 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.318378 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.318610 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.318713 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.318915 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.319000 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.319215 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.319300 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.319515 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.319615 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.319816 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.319980 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.320161 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.320254 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.320465 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.320560 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.320768 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.320855 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.321114 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.321303 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.321656 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.321751 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.322001 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.322086 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.322315 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.322402 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.322631 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.322724 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.322943 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.323029 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.323256 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.323349 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.323568 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.323662 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.323899 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.323998 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.324212 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.324316 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.324522 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.324611 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.324828 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.324913 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.325136 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.325228 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.325459 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.325557 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.325770 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.325856 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.326095 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.326188 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.326400 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.326487 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.326714 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.326800 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.327034 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.327127 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.327352 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.327438 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.327662 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.327747 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.327998 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.328134 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.328311 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.328396 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.328622 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.328716 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.328931 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.329025 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.329243 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.329336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.329556 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.329641 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.329863 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.329956 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.330180 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.330272 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.330487 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.330580 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.330803 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.330889 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.331104 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.331189 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.331417 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.331502 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.331724 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.331809 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.332066 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.332153 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.332371 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.332457 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.332687 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.332774 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.333014 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.333100 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.333325 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.333409 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.333633 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.333720 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.333941 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.334024 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.334246 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.334339 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.334555 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.334641 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.334863 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.334946 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.335170 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.335267 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.335471 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.335562 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.335775 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.335878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.336115 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.336213 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.336423 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.337059 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.337284 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.337468 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.337596 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.337902 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.337995 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.338217 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.338303 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.338525 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.338619 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.338827 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.338921 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.339129 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.339223 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.339438 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.339533 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.339758 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.339894 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.340091 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.340176 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.340415 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.340518 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.340737 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.340831 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.341041 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.341134 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.341362 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.341505 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.341657 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.341743 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.341962 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.342046 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.342265 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.342360 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.342570 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.342656 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.342871 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.342964 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.343185 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.343272 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.343494 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.343583 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.343795 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.343899 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.344124 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.344210 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.344435 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.344521 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.344742 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.344827 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.345054 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.345141 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.345363 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.345448 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.345672 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.345765 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.345974 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.346066 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.346280 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.346365 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.346592 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.346685 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.346897 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.346981 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.347199 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.347293 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.347503 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.347597 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.347805 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.347917 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.348147 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.348232 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.348458 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.348555 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.348760 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.348845 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.349068 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.349154 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.349372 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.349470 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.349679 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.349764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.349991 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.350076 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.350299 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.350558 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.350643 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.350891 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.350990 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.351207 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.351302 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.351511 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.351596 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.351821 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.351937 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.352194 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.352806 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.353109 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.353196 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.353438 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.353660 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.353745 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.353992 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.354090 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.354307 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.354392 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.354622 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.354707 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.354927 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.355024 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.355231 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.355319 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.355534 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.355618 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.355859 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.355949 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.356182 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.356423 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.356520 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.356759 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.356856 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.357075 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.357162 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.357375 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.357460 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.357680 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.357774 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.357997 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.358165 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.358303 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.358396 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.358615 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.358701 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.358918 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.359005 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.359239 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.359325 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.359546 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.359631 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.359861 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.359949 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.360164 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.360263 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.360468 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.360563 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.360767 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.360853 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.361069 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.361161 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.361371 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.361469 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.361678 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.361764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.361980 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.362066 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.362281 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.362376 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.362580 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.362666 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.362882 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.362967 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.363192 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.363286 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.363492 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.363627 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.363800 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.363913 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.364124 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.364224 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.364437 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.364523 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.364739 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.364824 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.365037 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.365123 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.365338 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.365423 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.365639 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.365724 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.365943 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.366029 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.366247 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.366339 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.366555 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.366641 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.366859 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.366946 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.367173 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.367258 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.367480 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.367574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.367803 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.367931 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.368129 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.368443 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.368541 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.368744 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.368840 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.369046 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.369140 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.369352 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.369438 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.369653 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.369781 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.369961 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.370053 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.370262 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.370347 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.370565 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.370660 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.370867 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.370953 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.371175 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.371296 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.371481 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.371570 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.371781 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.371897 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.372116 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.372211 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.372420 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.372506 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.372721 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.372807 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.373024 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.373120 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.373325 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.373410 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.373626 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.373712 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.373927 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.374022 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.374230 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.374316 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.374534 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.374627 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.374841 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.374936 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.375141 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.375227 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.375449 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.375540 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.375751 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.375884 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.376078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.376181 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.376381 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.376466 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.376684 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.376776 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.376983 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.377075 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.377283 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.377369 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.377585 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.377672 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.377887 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.377972 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.378188 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.378275 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.378491 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.378577 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.378797 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.378883 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.379111 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.379211 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.379398 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.379483 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.379697 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.379789 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.380043 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.380142 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.380351 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.380436 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.380652 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.380745 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.380960 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.381059 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.381262 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.381349 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.381566 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.381651 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.381869 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.381967 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.382174 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.382260 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.382474 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.382569 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.382773 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.382861 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.383072 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.383158 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.383395 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.383491 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.383710 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.384000 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.384119 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.384324 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.384579 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.384665 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.384907 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.385002 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.385219 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.385295 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.387949 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.388100 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.388229 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.388340 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.388340 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.388534 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.388648 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.388838 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.388946 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.389050 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.389152 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.389254 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.389356 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.389472 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.389584 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.389689 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.389792 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.389894 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.390517 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.390613 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.390701 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.390780 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.390857 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.390933 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391021 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391101 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391177 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391260 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391338 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391426 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391512 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391590 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391667 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391750 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391828 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.391953 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392034 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392111 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392280 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392359 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392451 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392530 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392606 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392689 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392774 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392851 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.392936 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.393015 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.393091 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.393166 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.393242 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.393365 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.393455 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.393673 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.393760 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.393976 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.394061 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.394283 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.394369 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.394594 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.394711 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.394903 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.395009 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.395222 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.395310 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.395525 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.395621 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.395829 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.395985 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.396162 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.396275 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.396471 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.396584 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.396778 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.396890 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.397109 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.397223 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.397416 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.397535 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.397720 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.397846 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.398025 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.398146 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.398328 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.398437 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.398630 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.398755 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.398930 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.399587 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.399782 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.400120 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.400253 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.400439 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.400620 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.400854 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.400976 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.401162 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.401278 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.401466 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.401582 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.401838 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.401924 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.402158 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.402257 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.402725 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.402818 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.403031 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.403126 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.403350 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.403446 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.403672 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.403760 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.403997 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.404086 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.404311 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.404413 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.404620 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.404708 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.404940 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.405035 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.405248 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.405348 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.405554 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.405641 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.405862 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.405948 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.406165 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.406264 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.406468 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.406565 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.406788 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.406876 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.407090 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.407179 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.407407 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.407497 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.407820 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.407978 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.408152 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.408239 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.408458 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.408548 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.408778 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.408864 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.409104 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.409191 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.409409 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.409498 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.409713 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.409800 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.410022 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.410111 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.410326 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.410423 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.410630 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.410718 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.410952 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.411053 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.411259 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.411354 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.411569 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.411669 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.411897 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.412004 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.412206 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.412295 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.412509 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.412597 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.412812 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.412908 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.413132 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.413228 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.413435 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.413530 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.413745 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.413845 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.414056 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.414143 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.414376 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.414473 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.415292 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.415407 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.415600 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.415945 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.416065 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.416253 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.416351 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.416556 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.416645 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.416859 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.416948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.417163 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.417261 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.417481 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.417569 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.417791 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.417880 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.418097 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.418194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.418419 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.418508 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.418724 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.418812 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.419036 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.419126 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.419349 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.419437 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.419658 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.419795 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.419988 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.420088 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.420293 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.420389 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.420610 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.420697 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.420910 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.420997 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.421230 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.421318 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.421538 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.421749 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.421848 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.421931 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.422143 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.422232 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.422448 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.422549 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.422753 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.422841 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.423059 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.423146 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.423359 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.423454 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.423658 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.423753 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.423981 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.424071 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.424306 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.424412 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.424610 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.424700 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.424927 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.425023 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.425234 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.425332 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.425537 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.425625 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.425842 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.425929 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.426149 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.426237 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.426485 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.426571 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.426786 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.426873 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.427099 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.427188 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.427414 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.427501 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.427735 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.427823 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.428064 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.428153 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.428371 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.428459 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.428679 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.428776 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.428978 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.429066 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.429281 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.429369 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.429584 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.429681 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.429889 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.429989 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.430191 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.430300 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.430573 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.430728 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.430950 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.431125 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.431270 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.431466 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.431778 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.431932 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.432128 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.432239 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.432439 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.432528 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.432744 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.432841 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.433049 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.433137 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.433352 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.433439 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.433665 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.433762 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.433976 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.434068 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.434287 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.434375 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.434593 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.434682 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.434901 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.434990 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.435216 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.435311 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.435530 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.435619 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.435867 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.435959 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.436180 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.436294 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.436481 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.436940 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.437034 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.437115 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.437194 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.437287 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.437391 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.437479 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.437710 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.437797 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.438025 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.438115 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.438338 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.438427 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.438651 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.438867 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.438965 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.439197 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.439285 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.439511 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.439598 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.439822 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.439957 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.440154 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.440255 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.440467 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.440556 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.440773 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.440869 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.441080 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.441168 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.441389 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.441476 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.441698 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.441795 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.442009 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.442101 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.442316 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.442415 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.442635 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.442734 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.442942 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.443030 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.443254 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.443343 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.443567 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.443665 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.443899 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.444121 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.444210 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.444440 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.444530 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.444773 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.444862 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.445097 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.445192 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.445421 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.445511 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.445739 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.445828 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.446191 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.446302 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.446586 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.446743 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.446931 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.447064 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.447270 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.447367 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.447613 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.447708 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.447973 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.448065 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.448306 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.448412 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.448615 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.448702 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.448931 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.449027 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.449247 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.449344 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.449573 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.449662 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.449904 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.450042 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.450224 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.450459 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.450549 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.450827 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.450916 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.451141 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.451237 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.451490 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.451657 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.451847 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.451993 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.452187 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.452318 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.452510 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.452644 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.452849 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.452967 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.453172 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.453286 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.453490 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.453600 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.453820 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.453909 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.454143 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.454232 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.454458 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.454545 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.454775 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.454864 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.455090 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.455179 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.455393 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.455480 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.455708 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.455804 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.456040 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.456138 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.456343 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.456432 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.456664 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.456767 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.456973 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.457062 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.457289 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.457505 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.457593 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.457852 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.457942 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.458167 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.458256 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.458489 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.458584 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.458814 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.458913 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.459127 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.459215 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.459431 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.459519 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.459747 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.459853 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.460077 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.460175 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.460384 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.460481 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.460698 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.460794 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.461009 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.461106 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.461324 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.461427 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.462193 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.462307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.462527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.462768 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.462863 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.463126 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.463228 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.463436 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.463527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.463748 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.463872 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.464081 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.464231 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.464410 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.464511 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.464716 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.464819 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.465023 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.465112 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.465329 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.465417 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.465640 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.465908 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.466007 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.466239 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.466326 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.466544 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.466645 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.466847 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.466937 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.467159 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.467249 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.467464 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.467551 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.467770 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.467881 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.468106 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.468196 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.468418 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.468519 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.468767 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.468854 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.469073 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.469204 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.469378 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.469512 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.469690 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.469777 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.469991 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.470086 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.470295 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.470394 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.470609 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.470696 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.470917 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.471004 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.471227 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.471323 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.471537 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.471623 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.471880 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.471972 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.472182 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.472330 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.472498 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.472587 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.472812 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.473040 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.473139 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.473374 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.473463 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.473695 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.473784 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.474027 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.474124 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.474355 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.474443 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.474662 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.474750 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.474967 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.475064 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.475272 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.475360 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.475593 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.475691 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.475930 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.476024 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.476243 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.476331 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.476553 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.476641 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.476866 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.476963 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.477736 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.477836 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.478277 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.478461 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.478701 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.478789 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.479018 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.479107 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.479332 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.479439 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.479645 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.479745 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.479978 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.480081 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.480292 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.480390 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.480605 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.480693 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.480915 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.481011 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.481226 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.481316 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.481567 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.481655 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.481890 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.481986 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.482209 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.482345 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.482524 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.482616 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.482843 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.482941 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.483155 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.483244 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.483464 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.483550 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.483773 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.483889 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.484111 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.484208 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.484424 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.484512 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.484733 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.484830 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.485044 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.485134 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.485346 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.485433 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.485653 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.485966 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.486054 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.486276 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.486364 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.486584 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.486672 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.486896 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.486985 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.487203 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.487292 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.487512 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.487610 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.487820 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.487938 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.488146 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.488234 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.488453 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.488555 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.488760 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.488848 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.489070 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.489157 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.489376 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.489472 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.489684 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.489772 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.489988 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.490077 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.490295 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.490392 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.490648 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.490751 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.490921 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.491010 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.491228 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.491318 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.491545 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.491634 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.491872 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.491976 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.492180 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.492271 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.492489 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.492600 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.492821 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.492916 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.493148 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.493362 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.493455 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.493703 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.493802 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.494013 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.494116 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.494319 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.494435 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.494632 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.494732 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.494937 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.495027 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.495243 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.495330 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.495547 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.495648 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.495868 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.495960 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.496176 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.496276 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.496479 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.496567 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.496787 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.496877 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.497090 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.497178 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.497396 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.497492 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.497699 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.497787 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.498006 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.498101 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.498308 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.498414 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.498638 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.498728 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.498969 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.499057 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.499279 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.499376 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.499593 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.499684 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.499930 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.500021 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.500246 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.500347 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.500553 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.500640 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.500871 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.500959 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.501188 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.501278 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.501500 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.501587 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.501809 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.501899 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.502124 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.502215 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.502434 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.502585 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.502743 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.502839 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.503052 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.503150 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.503360 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.503512 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.503668 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.503767 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.503999 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.504089 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.504323 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.504425 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.504646 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.504744 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.504951 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.505041 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.505271 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.505362 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.505587 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.505685 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.505906 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.505995 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.506150 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 10:55:33.506237 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.506514 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.506839 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.507147 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.507457 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.507764 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.508104 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.508444 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.508787 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.509098 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.509409 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.509723 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.510037 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.510364 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.510686 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.510994 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.511319 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.511643 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.512011 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.512329 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.512666 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.512993 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.513306 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.513616 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.513918 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:55:33.514160 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 10:55:33.660890 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO dbcounter [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Registered counter for database nova_api Oct 06 10:55:33.670943 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO dbcounter [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Registered counter for database nova_api Oct 06 10:55:33.682921 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_db.sqlalchemy.engines [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 10:55:33.689647 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writer thread running {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 10:55:33.691519 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG oslo_db.sqlalchemy.engines [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 10:55:33.698642 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writer thread running {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 10:55:33.748636 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.context [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64583f48-9147-4152-987f-d1b239ba1ce3(cell1) {{(pid=105607) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 10:55:33.752531 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 10:55:33.753014 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 10:55:33.754590 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 10:55:33.755332 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 10:55:33.755922 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 10:55:33.757160 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.context [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64583f48-9147-4152-987f-d1b239ba1ce3(cell1) {{(pid=105608) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 10:55:33.757788 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 10:55:33.760671 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO dbcounter [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Registered counter for database nova_cell0 Oct 06 10:55:33.761868 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG oslo_concurrency.lockutils [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 10:55:33.762342 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG oslo_concurrency.lockutils [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 10:55:33.763897 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG oslo_concurrency.lockutils [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 10:55:33.764641 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG oslo_concurrency.lockutils [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 10:55:33.764792 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO dbcounter [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Registered counter for database nova_cell1 Oct 06 10:55:33.765090 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG oslo_concurrency.lockutils [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 10:55:33.767039 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG oslo_concurrency.lockutils [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 10:55:33.771219 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO dbcounter [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Registered counter for database nova_cell0 Oct 06 10:55:33.772048 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_db.sqlalchemy.engines [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 10:55:33.773212 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO dbcounter [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Registered counter for database nova_cell1 Oct 06 10:55:33.774850 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_db.sqlalchemy.engines [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 10:55:33.780817 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writer thread running {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 10:55:33.781302 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG oslo_db.sqlalchemy.engines [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 10:55:33.782303 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writer thread running {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 10:55:33.785954 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writer thread running {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 10:55:33.786571 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG oslo_db.sqlalchemy.engines [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 10:55:33.928057 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO dbcounter [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Registered counter for database nova_cell0 Oct 06 10:55:33.935035 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_db.sqlalchemy.engines [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 10:55:33.935577 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writer thread running {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 10:55:33.939736 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writer thread running {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 10:55:33.945822 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO dbcounter [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Registered counter for database nova_cell0 Oct 06 10:55:33.955969 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG oslo_db.sqlalchemy.engines [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 10:55:33.960650 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writer thread running {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 10:55:34.281689 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: WARNING keystonemiddleware.auth_token [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 10:55:34.287220 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: WARNING keystonemiddleware.auth_token [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 10:55:34.288985 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: WARNING keystonemiddleware.auth_token [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 10:55:34.294934 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: WARNING keystonemiddleware.auth_token [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 10:55:34.635903 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: WARNING keystonemiddleware.auth_token [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 10:55:34.641822 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: WARNING keystonemiddleware.auth_token [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 10:55:34.642337 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: WARNING keystonemiddleware.auth_token [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 10:55:34.647132 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6511f79c0 pid: 105607 (default app) Oct 06 10:55:34.648272 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: WARNING keystonemiddleware.auth_token [None req-b53be480-7972-421a-ab62-7e70c9c2a02d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 10:55:34.649322 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:55:34.650523 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001820 Oct 06 10:55:34.650933 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Thu Oct 6 10:55:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:55:34.654289 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6511f79c0 pid: 105608 (default app) Oct 06 10:56:55.645923 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:56:55.647116 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Oct 06 10:56:55.648101 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:56:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:56:55.660128 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writing DB stats nova_api:SELECT=3 {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:55.661041 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writing DB stats nova_cell0:SELECT=3 {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:55.661893 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writing DB stats nova_cell1:SELECT=3 {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:55.662920 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writing DB stats nova_cell0:SELECT=3 {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:56.567082 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-f4fb1068-d994-4b59-803c-8bbde8a79c23 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:56:56.599810 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-f4fb1068-d994-4b59-803c-8bbde8a79c23 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.945132 Oct 06 10:56:56.601605 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Thu Oct 6 10:56:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 10:56:59.240218 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:56:59.241145 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-ac25de4c-3afb-4c6f-aadf-6210b9a24794 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 06 10:56:59.241912 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:56:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:56:59.696549 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-2ddae672-7dc0-4790-93a1-0c71153850d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 256}} {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:56:59.745197 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-2ddae672-7dc0-4790-93a1-0c71153850d9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497463 Oct 06 10:56:59.745748 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Oct 6 10:56:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 10:56:59.761763 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writing DB stats nova_api:SELECT=3 {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:59.762574 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writing DB stats nova_cell1:SELECT=3 {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:59.764491 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writing DB stats nova_cell0:SELECT=3 {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:59.765254 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:59.971420 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-6ea0099c-b4dc-4265-a0a5-93fdc330550d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:00.043041 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-6ea0099c-b4dc-4265-a0a5-93fdc330550d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287426 Oct 06 10:57:00.044207 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Thu Oct 6 10:56:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 10:57:02.684421 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-2ddae672-7dc0-4790-93a1-0c71153850d9 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:02.685449 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-2ddae672-7dc0-4790-93a1-0c71153850d9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 06 10:57:02.685864 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:03.346469 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-6ec6ade2-899f-48c0-b445-3909dceea0f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:03.388147 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-6ec6ade2-899f-48c0-b445-3909dceea0f1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.696044 Oct 06 10:57:03.389209 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Oct 6 10:57:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:57:03.404466 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-0b3b264f-8038-4d61-8c6b-f9423219be9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:03.448322 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-0b3b264f-8038-4d61-8c6b-f9423219be9d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050676 Oct 06 10:57:03.449016 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Thu Oct 6 10:57:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 10:57:06.115170 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-6ec6ade2-899f-48c0-b445-3909dceea0f1 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:06.116233 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-6ec6ade2-899f-48c0-b445-3909dceea0f1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 06 10:57:06.117420 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:06.540325 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-76394831-877f-4a5c-8a23-4f9dbb761e18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "id": "d2"}} {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:06.560737 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-76394831-877f-4a5c-8a23-4f9dbb761e18 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436744 Oct 06 10:57:06.561614 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Oct 6 10:57:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:57:06.573678 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-c610a21f-7a86-4dc0-860b-108dfc972b92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:06.604246 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-c610a21f-7a86-4dc0-860b-108dfc972b92 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034425 Oct 06 10:57:06.604829 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Thu Oct 6 10:57:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 10:57:09.354517 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-76394831-877f-4a5c-8a23-4f9dbb761e18 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:09.355439 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-76394831-877f-4a5c-8a23-4f9dbb761e18 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 06 10:57:09.355858 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:09.774854 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-d4e206cd-1528-476b-8787-c74532e7728b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "id": "d3"}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:09.797743 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-d4e206cd-1528-476b-8787-c74532e7728b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435781 Oct 06 10:57:09.798428 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Oct 6 10:57:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:57:09.812090 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-5dfa06ea-cf78-4cff-8804-2197b4302cb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:09.840401 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-5dfa06ea-cf78-4cff-8804-2197b4302cb9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032558 Oct 06 10:57:09.841101 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Thu Oct 6 10:57:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 10:57:12.514050 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-d4e206cd-1528-476b-8787-c74532e7728b admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:12.515426 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-d4e206cd-1528-476b-8787-c74532e7728b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Oct 06 10:57:12.515978 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:12.979644 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-2d28d2d5-8408-4c4f-9fb7-180204de42b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "vcpus": 4, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:13.001521 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-2d28d2d5-8408-4c4f-9fb7-180204de42b3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479437 Oct 06 10:57:13.002251 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Oct 6 10:57:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:57:13.016631 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-5554cffc-627a-4a0a-b397-ca0da0ee7fe5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:13.045885 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-5554cffc-627a-4a0a-b397-ca0da0ee7fe5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034267 Oct 06 10:57:13.046478 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Thu Oct 6 10:57:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 10:57:16.108266 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-2d28d2d5-8408-4c4f-9fb7-180204de42b3 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:16.109630 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-2d28d2d5-8408-4c4f-9fb7-180204de42b3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 Oct 06 10:57:16.110263 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:16.539566 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-d19fc5ed-a42a-4add-ae47-52979bb85273 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:16.565197 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-d19fc5ed-a42a-4add-ae47-52979bb85273 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.446551 Oct 06 10:57:16.565744 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Thu Oct 6 10:57:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 10:57:19.246071 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-2d28d2d5-8408-4c4f-9fb7-180204de42b3 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:19.247098 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-2d28d2d5-8408-4c4f-9fb7-180204de42b3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 06 10:57:19.247500 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:19.646028 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-252f5c75-ba64-4645-a033-1fb576cc8783 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "swap": 0, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:19.667180 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-252f5c75-ba64-4645-a033-1fb576cc8783 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.413349 Oct 06 10:57:19.667904 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Oct 6 10:57:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 10:57:19.680577 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-22f865f2-7aae-4207-955c-885f2bad4005 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:19.709675 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-22f865f2-7aae-4207-955c-885f2bad4005 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033444 Oct 06 10:57:19.710473 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Thu Oct 6 10:57:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 10:57:22.369870 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-252f5c75-ba64-4645-a033-1fb576cc8783 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:22.370892 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-252f5c75-ba64-4645-a033-1fb576cc8783 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 06 10:57:22.371288 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:22.777132 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-f945f18d-bb1d-4425-8ac5-f1cba9ff9b6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:22.796696 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-f945f18d-bb1d-4425-8ac5-f1cba9ff9b6e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419032 Oct 06 10:57:22.797768 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Oct 6 10:57:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:57:22.810941 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-fd440421-c1a8-49a5-807e-37378d6fc341 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:22.841230 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-fd440421-c1a8-49a5-807e-37378d6fc341 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033897 Oct 06 10:57:22.842202 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Thu Oct 6 10:57:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 10:57:25.494533 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-f945f18d-bb1d-4425-8ac5-f1cba9ff9b6e admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:25.496213 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-f945f18d-bb1d-4425-8ac5-f1cba9ff9b6e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Oct 06 10:57:25.496851 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:26.003265 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-cba362c8-76e3-42b5-ae20-7e3365cb16a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:26.030412 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-cba362c8-76e3-42b5-ae20-7e3365cb16a7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.524905 Oct 06 10:57:26.031805 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Oct 6 10:57:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 10:57:26.047554 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-89faf23a-72b5-45c3-9ea0-e5b885bada84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:26.065061 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:26.143166 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-89faf23a-72b5-45c3-9ea0-e5b885bada84 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102562 Oct 06 10:57:26.145439 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Thu Oct 6 10:57:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 10:57:28.811222 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-cba362c8-76e3-42b5-ae20-7e3365cb16a7 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:28.812182 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-cba362c8-76e3-42b5-ae20-7e3365cb16a7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 06 10:57:28.812978 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:29.243653 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-bab49f5f-864e-4c03-9cba-b7cc72e3b07d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true}} {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:29.264166 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-bab49f5f-864e-4c03-9cba-b7cc72e3b07d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444832 Oct 06 10:57:29.265054 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Oct 6 10:57:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:57:29.277872 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-f71d964e-c8cd-4f5e-af0d-18873745d9c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:29.301502 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-f71d964e-c8cd-4f5e-af0d-18873745d9c0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028135 Oct 06 10:57:29.302300 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Thu Oct 6 10:57:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 10:57:31.974546 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-bab49f5f-864e-4c03-9cba-b7cc72e3b07d admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:31.975483 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-bab49f5f-864e-4c03-9cba-b7cc72e3b07d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 06 10:57:31.975903 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:32.413142 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-c9e0b48b-fa14-42af-8f7c-502e43dd7b53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:32.421429 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:32.439771 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-c9e0b48b-fa14-42af-8f7c-502e43dd7b53 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453933 Oct 06 10:57:32.443488 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Thu Oct 6 10:57:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:57:32.456439 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-6b6475f6-b96d-4dd1-b2c0-094040eb421a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:32.481671 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-6b6475f6-b96d-4dd1-b2c0-094040eb421a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029283 Oct 06 10:57:32.482170 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Thu Oct 6 10:57:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 10:57:48.677737 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-c9e0b48b-fa14-42af-8f7c-502e43dd7b53 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:48.679449 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-c9e0b48b-fa14-42af-8f7c-502e43dd7b53 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 06 10:57:48.680070 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:57:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:48.690675 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:49.072001 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-8f56498d-a440-4f89-9bfd-7c8615cf4358 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:49.092329 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-8f56498d-a440-4f89-9bfd-7c8615cf4358 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406300 Oct 06 10:57:49.092853 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Thu Oct 6 10:57:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 10:57:50.409113 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-c9e0b48b-fa14-42af-8f7c-502e43dd7b53 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:50.410153 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-c9e0b48b-fa14-42af-8f7c-502e43dd7b53 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 06 10:57:50.410659 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 10:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:50.929904 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-4416c670-ecd9-4da7-872e-3a9e957914b3 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:50.935349 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.wsgi [None req-4416c670-ecd9-4da7-872e-3a9e957914b3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-4416c670-ecd9-4da7-872e-3a9e957914b3 admin admin] Request method failure captured: Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Accept: application/json Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Accept-Encoding: gzip, deflate Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Connection: keep-alive Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Content-Length: 0 Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Host: 10.222.0.52 Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Openstack-Api-Version: compute 2.92 Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Openstack-System-Scope: None Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: User-Agent: python-novaclient Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Auth-Token: gAAAAABjPrSuzg0UbCQmHb4tUFvZ8WsUHhuizUDHoz2gyg3EqyaD3BKQhSW7q5or9hlofGiY6o0RIfJO6_2JGDV82kPPLOufuLNGOHJpBng1zW-bc8DD6zdFIEn1-wPw59O1Q3iJwesdbmSwWmcbGkrIr_hi1cXAksLFs5LjIw1GnBvS1R0v8Vc Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Domain-Id: None Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Domain-Name: None Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Identity-Status: Confirmed Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Is-Admin-Project: True Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Domain-Id: default Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Domain-Name: Default Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Name: admin Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Role: admin,reader,member Oct 06 10:57:50.938574 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Roles: admin,reader,member Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Tenant: admin Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Tenant-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Tenant-Name: admin Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User: admin Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Domain-Id: default Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Domain-Name: Default Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Id: dd261f057dda47fbbc28e2f5e9b2f3e7 Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Name: admin Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: method: > Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: exception: Flavor 42 could not be found. Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: action_args: {'id': '42'} Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 10:57:50.940240 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:50.941221 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:50.942578 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-4416c670-ecd9-4da7-872e-3a9e957914b3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 10:57:50.943909 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-4416c670-ecd9-4da7-872e-3a9e957914b3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391096 Oct 06 10:57:50.943909 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Oct 6 10:57:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:50.951783 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-c9cf42c9-1d04-4640-915a-9ffad33548ea admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:50.974345 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-c9cf42c9-1d04-4640-915a-9ffad33548ea admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026871 Oct 06 10:57:50.974888 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Oct 6 10:57:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 10:57:50.985975 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-07e0a983-5a4b-42e1-ad01-b55cf621bcbc admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:51.008138 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-07e0a983-5a4b-42e1-ad01-b55cf621bcbc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026617 Oct 06 10:57:51.008778 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Oct 6 10:57:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 10:57:51.018341 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-539fb885-5eaf-4acc-9141-9fc0e452935a admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:51.024425 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.wsgi [None req-539fb885-5eaf-4acc-9141-9fc0e452935a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-539fb885-5eaf-4acc-9141-9fc0e452935a admin admin] Request method failure captured: Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Accept: application/json Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Accept-Encoding: gzip, deflate Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Connection: keep-alive Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Content-Length: 0 Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Host: 10.222.0.52 Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Openstack-Api-Version: compute 2.92 Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Openstack-System-Scope: None Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: User-Agent: python-novaclient Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Auth-Token: gAAAAABjPrSuzg0UbCQmHb4tUFvZ8WsUHhuizUDHoz2gyg3EqyaD3BKQhSW7q5or9hlofGiY6o0RIfJO6_2JGDV82kPPLOufuLNGOHJpBng1zW-bc8DD6zdFIEn1-wPw59O1Q3iJwesdbmSwWmcbGkrIr_hi1cXAksLFs5LjIw1GnBvS1R0v8Vc Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Domain-Id: None Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Domain-Name: None Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Identity-Status: Confirmed Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Is-Admin-Project: True Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Domain-Id: default Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Domain-Name: Default Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Name: admin Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Role: admin,reader,member Oct 06 10:57:51.027949 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Roles: admin,reader,member Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Tenant: admin Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Tenant-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Tenant-Name: admin Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User: admin Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Domain-Id: default Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Domain-Name: Default Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Id: dd261f057dda47fbbc28e2f5e9b2f3e7 Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Name: admin Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: method: > Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: exception: Flavor 42 could not be found. Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: action_args: {'id': '42'} Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 10:57:51.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:51.030307 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:51.031581 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-539fb885-5eaf-4acc-9141-9fc0e452935a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 10:57:51.032807 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-539fb885-5eaf-4acc-9141-9fc0e452935a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014676 Oct 06 10:57:51.032807 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Oct 6 10:57:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 06 10:57:52.262601 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-07e0a983-5a4b-42e1-ad01-b55cf621bcbc admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:52.263608 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-07e0a983-5a4b-42e1-ad01-b55cf621bcbc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 06 10:57:52.264030 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 10:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:52.787216 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-0b04c694-bddf-4876-9bf1-fa0c30a35512 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:52.792975 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.wsgi [None req-0b04c694-bddf-4876-9bf1-fa0c30a35512 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-0b04c694-bddf-4876-9bf1-fa0c30a35512 admin admin] Request method failure captured: Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Accept: application/json Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Accept-Encoding: gzip, deflate Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Connection: keep-alive Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Content-Length: 0 Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Host: 10.222.0.52 Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Openstack-Api-Version: compute 2.92 Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Openstack-System-Scope: None Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: User-Agent: python-novaclient Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Auth-Token: gAAAAABjPrSwnhxjS3MkX4JfO4qX5DE0yfBZQF8xVNS1K3lE9KoVTJ-00j7AeZ_6wzYi-QGIcC0FrMwub1UBVyadSXw4YoFOUW6Hbs9Qk16mzZijADnvdhyMSaIlqmyhaHZv-U_9xGQlzgZsbuJ8SYyYsMaJg20Y5iJeM8ULdgSR9ij8xkDxzNY Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Domain-Id: None Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Domain-Name: None Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Identity-Status: Confirmed Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Is-Admin-Project: True Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Domain-Id: default Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Domain-Name: Default Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Name: admin Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Role: admin,reader,member Oct 06 10:57:52.794522 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Roles: admin,reader,member Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Tenant: admin Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Tenant-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Tenant-Name: admin Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User: admin Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Domain-Id: default Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Domain-Name: Default Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Id: dd261f057dda47fbbc28e2f5e9b2f3e7 Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Name: admin Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: method: > Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: exception: Flavor 84 could not be found. Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: action_args: {'id': '84'} Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 10:57:52.796085 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:52.797069 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:52.798413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-0b04c694-bddf-4876-9bf1-fa0c30a35512 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 10:57:52.799641 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-0b04c694-bddf-4876-9bf1-fa0c30a35512 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393752 Oct 06 10:57:52.799641 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Oct 6 10:57:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:52.806331 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-caf14cef-039b-4ecc-a044-35d35808defc admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:52.821316 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-caf14cef-039b-4ecc-a044-35d35808defc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019152 Oct 06 10:57:52.821973 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Oct 6 10:57:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 10:57:52.831266 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-e7c9d071-599e-409f-a5f6-913cf166b4ce admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:52.847346 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-e7c9d071-599e-409f-a5f6-913cf166b4ce admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019635 Oct 06 10:57:52.847892 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Oct 6 10:57:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 10:57:52.857822 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-2dadca09-6b35-4feb-b6da-b046da8ebcc9 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:52.862775 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.wsgi [None req-2dadca09-6b35-4feb-b6da-b046da8ebcc9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-2dadca09-6b35-4feb-b6da-b046da8ebcc9 admin admin] Request method failure captured: Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Accept: application/json Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Accept-Encoding: gzip, deflate Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Connection: keep-alive Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Content-Length: 0 Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Host: 10.222.0.52 Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Openstack-Api-Version: compute 2.92 Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Openstack-System-Scope: None Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: User-Agent: python-novaclient Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Auth-Token: gAAAAABjPrSwnhxjS3MkX4JfO4qX5DE0yfBZQF8xVNS1K3lE9KoVTJ-00j7AeZ_6wzYi-QGIcC0FrMwub1UBVyadSXw4YoFOUW6Hbs9Qk16mzZijADnvdhyMSaIlqmyhaHZv-U_9xGQlzgZsbuJ8SYyYsMaJg20Y5iJeM8ULdgSR9ij8xkDxzNY Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Domain-Id: None Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Domain-Name: None Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Identity-Status: Confirmed Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Is-Admin-Project: True Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Domain-Id: default Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Domain-Name: Default Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Name: admin Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Role: admin,reader,member Oct 06 10:57:52.864291 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Roles: admin,reader,member Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Tenant: admin Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Tenant-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Tenant-Name: admin Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User: admin Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Domain-Id: default Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Domain-Name: Default Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Id: dd261f057dda47fbbc28e2f5e9b2f3e7 Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Name: admin Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: method: > Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: exception: Flavor 84 could not be found. Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: action_args: {'id': '84'} Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 10:57:52.865941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:52.867078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:52.868496 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-2dadca09-6b35-4feb-b6da-b046da8ebcc9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 10:57:52.869743 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-2dadca09-6b35-4feb-b6da-b046da8ebcc9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011312 Oct 06 10:57:52.869743 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Oct 6 10:57:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 06 10:57:54.088357 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-e7c9d071-599e-409f-a5f6-913cf166b4ce admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:54.089365 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-e7c9d071-599e-409f-a5f6-913cf166b4ce admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 06 10:57:54.089766 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 10:57:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:54.607960 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-b34842e1-cdc6-4039-81c6-917af18c7331 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:54.613779 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.wsgi [None req-b34842e1-cdc6-4039-81c6-917af18c7331 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-b34842e1-cdc6-4039-81c6-917af18c7331 admin admin] Request method failure captured: Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Accept: application/json Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Accept-Encoding: gzip, deflate Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Connection: keep-alive Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Content-Length: 0 Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Host: 10.222.0.52 Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Openstack-Api-Version: compute 2.92 Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Openstack-System-Scope: None Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: User-Agent: python-novaclient Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Auth-Token: gAAAAABjPrSx6Yo7jx5rDiRAu3eUh6ooEKYvwDoWVV7gcFNax_YisEVMukvfg0tD_eV84fUw_reJcJmAek3B4hWLFtKP1zdCmWvMfpxF7c80hCv1YIJRiIrbtyNkCUroMynW2ENfv1z2PJud8qulWeZj34QpoLno30IrBlSoPSj3rw6ZPC1KpXk Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Domain-Id: None Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Domain-Name: None Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Identity-Status: Confirmed Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Is-Admin-Project: True Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Domain-Id: default Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Domain-Name: Default Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Project-Name: admin Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Role: admin,reader,member Oct 06 10:57:54.615336 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Roles: admin,reader,member Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Tenant: admin Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Tenant-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-Tenant-Name: admin Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User: admin Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Domain-Id: default Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Domain-Name: Default Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Id: dd261f057dda47fbbc28e2f5e9b2f3e7 Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: X-User-Name: admin Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: method: > Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: exception: Flavor 451 could not be found. Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: action_args: {'id': '451'} Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 10:57:54.617878 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:54.618948 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: ERROR nova.api.openstack.wsgi Oct 06 10:57:54.620317 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-b34842e1-cdc6-4039-81c6-917af18c7331 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 10:57:54.621565 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-b34842e1-cdc6-4039-81c6-917af18c7331 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.387585 Oct 06 10:57:54.621565 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Oct 6 10:57:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:54.627190 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-654f31c8-79b2-4a4e-999c-6ff7f7a8622c admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:54.642847 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-654f31c8-79b2-4a4e-999c-6ff7f7a8622c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019274 Oct 06 10:57:54.643363 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Oct 6 10:57:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 10:57:54.653825 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:54.669686 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019719 Oct 06 10:57:54.670201 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Oct 6 10:57:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 10:57:54.679677 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-3056d52c-ef30-4911-90f1-6ec74d42ac96 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:54.684631 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.wsgi [None req-3056d52c-ef30-4911-90f1-6ec74d42ac96 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-3056d52c-ef30-4911-90f1-6ec74d42ac96 admin admin] Request method failure captured: Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Accept: application/json Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Accept-Encoding: gzip, deflate Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Connection: keep-alive Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Content-Length: 0 Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Host: 10.222.0.52 Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Openstack-Api-Version: compute 2.92 Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Openstack-System-Scope: None Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: User-Agent: python-novaclient Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Auth-Token: gAAAAABjPrSx6Yo7jx5rDiRAu3eUh6ooEKYvwDoWVV7gcFNax_YisEVMukvfg0tD_eV84fUw_reJcJmAek3B4hWLFtKP1zdCmWvMfpxF7c80hCv1YIJRiIrbtyNkCUroMynW2ENfv1z2PJud8qulWeZj34QpoLno30IrBlSoPSj3rw6ZPC1KpXk Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Domain-Id: None Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Domain-Name: None Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Identity-Status: Confirmed Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Is-Admin-Project: True Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Domain-Id: default Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Domain-Name: Default Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Project-Name: admin Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Role: admin,reader,member Oct 06 10:57:54.686194 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Roles: admin,reader,member Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46752b92e78642e4b79f5ef50f2e51da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Tenant: admin Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Tenant-Id: 46752b92e78642e4b79f5ef50f2e51da Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-Tenant-Name: admin Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User: admin Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Domain-Id: default Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Domain-Name: Default Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Id: dd261f057dda47fbbc28e2f5e9b2f3e7 Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: X-User-Name: admin Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: method: > Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: exception: Flavor 451 could not be found. Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: action_args: {'id': '451'} Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 10:57:54.687625 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:54.688527 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: ERROR nova.api.openstack.wsgi Oct 06 10:57:54.689764 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-3056d52c-ef30-4911-90f1-6ec74d42ac96 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 10:57:54.690795 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-3056d52c-ef30-4911-90f1-6ec74d42ac96 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011812 Oct 06 10:57:54.690795 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Oct 6 10:57:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:55.895580 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:55.896665 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 06 10:57:55.897572 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 10:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:56.432763 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-5a4b1fb6-f52f-4778-8eaf-ab19e726375f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:56.452199 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-5a4b1fb6-f52f-4778-8eaf-ab19e726375f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.409257 Oct 06 10:57:56.452729 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Oct 6 10:57:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:57:57.659816 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:57.660895 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 06 10:57:57.661288 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 10:57:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:58.186225 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-79177ee7-7722-45eb-9318-5ffc5ed93bc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:58.204435 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-79177ee7-7722-45eb-9318-5ffc5ed93bc4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.406065 Oct 06 10:57:58.204916 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Oct 6 10:57:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:57:59.433827 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:57:59.434837 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 06 10:57:59.435235 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 10:57:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:57:59.957180 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-f9b4b6a1-ef98-470a-9f70-eb7260faeb8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:57:59.976398 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-f9b4b6a1-ef98-470a-9f70-eb7260faeb8f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402765 Oct 06 10:57:59.976940 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Oct 6 10:57:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:58:01.227076 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:58:01.228109 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 06 10:58:01.228655 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 10:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 10:58:01.753395 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-fbd88085-7f94-4a3e-9084-e57275bc8745 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 10:58:01.771667 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-fbd88085-7f94-4a3e-9084-e57275bc8745 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402776 Oct 06 10:58:01.772855 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Oct 6 10:58:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 10:58:02.984941 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:58:02.985957 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 06 10:58:02.986355 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 10:58:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:58:03.509369 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-215e0024-7fcc-46f1-b776-5822c5aef428 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:58:03.529587 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-215e0024-7fcc-46f1-b776-5822c5aef428 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.404421 Oct 06 10:58:03.530124 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Thu Oct 6 10:58:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 10:59:01.882264 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:59:01.883277 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-3c6c881e-870a-45b1-9ab8-924fc3093335 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 06 10:59:01.883669 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Thu Oct 6 10:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 10:59:01.894225 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:02.272933 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-4bfcf405-b535-4423-94f0-533678c92a8b admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:59:02.293839 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-4bfcf405-b535-4423-94f0-533678c92a8b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404146 Oct 06 10:59:02.294393 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Thu Oct 6 10:59:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 10:59:02.314984 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writing DB stats nova_api:SELECT=14 {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:02.319518 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-7b573714-f032-4966-bfb9-3f1b2b5fee5b admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:59:02.327011 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-7b573714-f032-4966-bfb9-3f1b2b5fee5b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013442 Oct 06 10:59:02.327523 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Thu Oct 6 10:59:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 10:59:02.340119 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-7f6e306f-eabb-401c-936d-fd3c5f5bd4dd admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:59:02.347413 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-7f6e306f-eabb-401c-936d-fd3c5f5bd4dd admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011297 Oct 06 10:59:02.348578 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Thu Oct 6 10:59:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 10:59:02.360078 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-abe50089-3d8d-41d5-99ac-b21bfd94b40d admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:59:02.367272 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-abe50089-3d8d-41d5-99ac-b21bfd94b40d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010726 Oct 06 10:59:02.367797 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Thu Oct 6 10:59:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 10:59:02.378915 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-fbc90384-01bf-444f-a35f-26444601b103 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 10:59:02.386175 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-fbc90384-01bf-444f-a35f-26444601b103 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010713 Oct 06 10:59:02.386694 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Thu Oct 6 10:59:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:02:00.916956 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-abe50089-3d8d-41d5-99ac-b21bfd94b40d admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:02:00.917977 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-abe50089-3d8d-41d5-99ac-b21bfd94b40d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 06 11:02:00.918376 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 11:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:02:01.063766 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writing DB stats nova_api:SELECT=6 {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:02:01.228566 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-30588305-6f55-4c1a-94b0-f042badfce4a admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:02:01.233161 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-30588305-6f55-4c1a-94b0-f042badfce4a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:02:01.234440 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-30588305-6f55-4c1a-94b0-f042badfce4a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:02:01.234888 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-30588305-6f55-4c1a-94b0-f042badfce4a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:02:01.235617 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-30588305-6f55-4c1a-94b0-f042badfce4a admin admin] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:02:01.236105 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-30588305-6f55-4c1a-94b0-f042badfce4a admin admin] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:02:01.236569 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-30588305-6f55-4c1a-94b0-f042badfce4a admin admin] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:02:01.267419 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-30588305-6f55-4c1a-94b0-f042badfce4a admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.205638 Oct 06 11:02:01.267992 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Oct 6 11:02:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 11:02:02.342744 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-abe50089-3d8d-41d5-99ac-b21bfd94b40d admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:02:02.344105 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-abe50089-3d8d-41d5-99ac-b21bfd94b40d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Oct 06 11:02:02.344532 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 11:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:02:02.537718 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-e3a806af-02d1-4b71-99ae-d2b60e636ca7 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:02:02.541264 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-e3a806af-02d1-4b71-99ae-d2b60e636ca7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:02:02.541985 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-e3a806af-02d1-4b71-99ae-d2b60e636ca7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:02:02.542417 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-e3a806af-02d1-4b71-99ae-d2b60e636ca7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:02:02.543174 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-e3a806af-02d1-4b71-99ae-d2b60e636ca7 admin admin] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:02:02.543627 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-e3a806af-02d1-4b71-99ae-d2b60e636ca7 admin admin] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:02:02.544079 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-e3a806af-02d1-4b71-99ae-d2b60e636ca7 admin admin] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:02:02.564465 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-e3a806af-02d1-4b71-99ae-d2b60e636ca7 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078988 Oct 06 11:02:02.564950 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Oct 6 11:02:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 11:02:14.069927 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-abe50089-3d8d-41d5-99ac-b21bfd94b40d admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:02:14.070932 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-abe50089-3d8d-41d5-99ac-b21bfd94b40d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 06 11:02:14.071320 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 11:02:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:02:14.212191 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writing DB stats nova_cell0:SELECT=4 {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:02:14.213022 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writing DB stats nova_cell1:SELECT=4 {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:02:14.213632 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG dbcounter [-] [105607] Writing DB stats nova_api:SELECT=8 {{(pid=105607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:02:14.261013 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-bb76c4e2-d758-462c-b591-d4da8c59c5e1 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:02:14.264420 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-bb76c4e2-d758-462c-b591-d4da8c59c5e1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:02:14.264899 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-bb76c4e2-d758-462c-b591-d4da8c59c5e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:02:14.265362 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-bb76c4e2-d758-462c-b591-d4da8c59c5e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:02:14.266336 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-bb76c4e2-d758-462c-b591-d4da8c59c5e1 admin admin] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:02:14.266783 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-bb76c4e2-d758-462c-b591-d4da8c59c5e1 admin admin] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:02:14.267204 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-bb76c4e2-d758-462c-b591-d4da8c59c5e1 admin admin] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:02:14.292208 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-bb76c4e2-d758-462c-b591-d4da8c59c5e1 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084359 Oct 06 11:02:14.292678 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Oct 6 11:02:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:02:15.371076 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG nova.api.openstack.wsgi [None req-abe50089-3d8d-41d5-99ac-b21bfd94b40d admin admin] Calling method '>' {{(pid=105608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:02:15.372117 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: INFO nova.api.openstack.requestlog [None req-abe50089-3d8d-41d5-99ac-b21bfd94b40d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 06 11:02:15.372513 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: [pid: 105608|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Oct 6 11:02:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:02:15.564201 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG nova.api.openstack.wsgi [None req-b1e7fac4-d31c-47a8-b819-db8e0b4f5fd1 admin admin] Calling method '>' {{(pid=105607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:02:15.567535 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-b1e7fac4-d31c-47a8-b819-db8e0b4f5fd1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:02:15.568042 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-b1e7fac4-d31c-47a8-b819-db8e0b4f5fd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:02:15.568469 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-b1e7fac4-d31c-47a8-b819-db8e0b4f5fd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:02:15.569207 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-b1e7fac4-d31c-47a8-b819-db8e0b4f5fd1 admin admin] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:02:15.569670 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-b1e7fac4-d31c-47a8-b819-db8e0b4f5fd1 admin admin] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:02:15.570082 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: DEBUG oslo_concurrency.lockutils [None req-b1e7fac4-d31c-47a8-b819-db8e0b4f5fd1 admin admin] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:02:15.592876 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: INFO nova.api.openstack.requestlog [None req-b1e7fac4-d31c-47a8-b819-db8e0b4f5fd1 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080914 Oct 06 11:02:15.593339 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: [pid: 105607|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Oct 6 11:02:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:03:13.503056 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: Thu Oct 6 11:03:13 2022 - graceful shutdown triggered... Oct 06 11:03:13.503585 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: Gracefully killing worker 2 (pid: 105608)... Oct 06 11:03:13.503100 dv-cinder-860209-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 06 11:03:13.504563 dv-cinder-860209-2-iscsi devstack@n-api.service[105607]: Gracefully killing worker 1 (pid: 105607)... Oct 06 11:03:13.630444 dv-cinder-860209-2-iscsi devstack@n-api.service[105608]: DEBUG dbcounter [-] [105608] Writing DB stats nova_api:SELECT=4 {{(pid=105608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:14.504125 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: worker 1 buried after 1 seconds Oct 06 11:03:14.504636 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: worker 2 buried after 1 seconds Oct 06 11:03:14.504636 dv-cinder-860209-2-iscsi devstack@n-api.service[105606]: goodbye to uWSGI. Oct 06 11:03:14.505698 dv-cinder-860209-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 06 11:03:14.506247 dv-cinder-860209-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 06 11:03:14.509097 dv-cinder-860209-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 06 11:03:14.519357 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 06 11:03:14.521390 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 11:03:14 2022] *** Oct 06 11:03:14.521390 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 11:03:14.521390 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 11:03:14.521390 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: nodename: dv-cinder-860209-2-iscsi Oct 06 11:03:14.521390 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: machine: x86_64 Oct 06 11:03:14.521390 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: clock source: unix Oct 06 11:03:14.521390 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: pcre jit disabled Oct 06 11:03:14.521390 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: detected number of CPU cores: 4 Oct 06 11:03:14.521390 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: current working directory: / Oct 06 11:03:14.521390 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: detected binary path: /usr/bin/uwsgi-core Oct 06 11:03:14.522156 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: your processes number limit is 47680 Oct 06 11:03:14.522156 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: your memory page size is 4096 bytes Oct 06 11:03:14.522156 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: detected max file descriptor number: 2048 Oct 06 11:03:14.522156 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: lock engine: pthread robust mutexes Oct 06 11:03:14.522156 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: thunder lock: enabled Oct 06 11:03:14.522156 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 06 11:03:14.522156 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 11:03:14.561957 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: Python main interpreter initialized at 0x55ea60d969c0 Oct 06 11:03:14.561957 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: python threads support enabled Oct 06 11:03:14.561957 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: your server socket listen backlog is limited to 100 connections Oct 06 11:03:14.561957 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: your mercy for graceful operations on workers is 90 seconds Oct 06 11:03:14.562391 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 11:03:14.562391 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: *** Operational MODE: preforking *** Oct 06 11:03:14.563315 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: *** uWSGI is running in multiple interpreter mode *** Oct 06 11:03:14.563480 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: spawned uWSGI master process (pid: 120584) Oct 06 11:03:14.563890 dv-cinder-860209-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 06 11:03:14.565998 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: spawned uWSGI worker 1 (pid: 120602, cores: 1) Oct 06 11:03:14.565998 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: spawned uWSGI worker 2 (pid: 120603, cores: 1) Oct 06 11:03:14.565998 dv-cinder-860209-2-iscsi devstack@n-api.service[120584]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 11:03:15.223819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 11:03:15.229051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 11:03:16.394234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 11:03:16.394234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: from cryptography.utils import int_from_bytes Oct 06 11:03:16.394836 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 11:03:16.394836 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: from cryptography.utils import int_from_bytes Oct 06 11:03:16.395248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 11:03:16.395248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: from cryptography.utils import int_from_bytes Oct 06 11:03:16.395674 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 11:03:16.395674 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: from cryptography.utils import int_from_bytes Oct 06 11:03:18.949156 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 11:03:18.949820 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 11:03:18.950167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 11:03:18.950358 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 11:03:18.950569 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 11:03:18.950958 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.951286 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.951607 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.951955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.952292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.952605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.952928 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.953832 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.954331 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.954553 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.954881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.955364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-2-iscsi {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.955694 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.956035 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.956353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.956679 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.956989 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.957317 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.957635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.958147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.959526 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.959526 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.959526 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.959978 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.960231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.960484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.960807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.961133 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.961447 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.961765 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.962159 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-2-iscsi {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.962489 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.962801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.963118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.963542 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.963874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.964203 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.964512 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.964635 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 11:03:18.965055 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 11:03:18.965128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.965128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.965320 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 11:03:18.965587 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.965809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 11:03:18.966061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.966273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 11:03:18.966467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.966658 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.966848 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.966999 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.967153 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.967338 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.967493 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.967640 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.967791 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.967997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.968156 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.968320 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.968473 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.968473 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.968755 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.969530 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.969700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.969860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.970014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.970014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.970351 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.970502 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.970657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.970657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.970974 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-2-iscsi {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.971133 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.971280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.971525 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.971702 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.971877 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.972030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.972242 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.972406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.972557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.972721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.972867 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.972867 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.973162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.973312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.973464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.973632 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.973785 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.973979 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.974127 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.975875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.976061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.976219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.976368 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.976513 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.976657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.976813 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.976979 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.977135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.977291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.977446 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.977446 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.977739 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.977739 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.978041 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.978041 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.978329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.978482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.978640 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.978792 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.978954 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-2-iscsi {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.979100 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.979244 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.979408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.979559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.979703 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.979916 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.980083 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.980235 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.980449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.980610 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.980755 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.980899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.981061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.981214 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.981368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.981525 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.981682 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.981835 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.981985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.981985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.982331 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.982476 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.982628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.982773 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.982917 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.983125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.983283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.983429 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.983573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.983718 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.983905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.984066 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.984211 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.984385 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.984626 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.984881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.985155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.987027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.987206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.987358 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.987513 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.987668 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.988050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.988222 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.988378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.988532 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.988687 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.988841 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.989002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.989164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.989336 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.989494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.989647 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.989964 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.990141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.990291 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.990488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.990699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.990849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.991004 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.991158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.991332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.991485 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.991643 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.991796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.992092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.992248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.992401 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.992559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.992704 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.992847 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.992998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.993151 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.993305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.993474 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.993628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.993773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.993916 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.994059 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.994212 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.994357 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.994508 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.994664 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.994815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.994961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.995164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.995315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.995615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.996207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.996372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.996518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.996673 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.996839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.997375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.997635 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.997800 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.997948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.998103 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.998256 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.998404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.998560 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.998705 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.998849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.999002 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.999156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.999309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.999467 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.999612 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.999765 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:18.999963 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.000119 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.000273 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.000426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.000644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.000805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.000959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.001115 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.001261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.001407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.001552 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.001711 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.001857 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.002002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.002145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.002296 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.002461 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.002617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.002769 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.002913 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.003057 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.003209 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.003209 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.003501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.003650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.003801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.003973 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.004129 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.004360 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.004519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.004672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.004817 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.004961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.005104 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.005262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.005415 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.005679 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.006297 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.006466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.006631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.006787 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.006941 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.007115 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.007566 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.007722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.007899 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.008059 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.008203 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.008358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.008512 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.008665 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.008822 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.008979 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.009124 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.009309 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.009466 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.009618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.009763 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.009915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.010062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.010215 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.010371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.010523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.010715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.010866 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.011018 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.011173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.011329 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.011482 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.011627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.011770 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.011955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.012112 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.012265 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.012418 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.012563 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.012707 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.012860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.013006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.013157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.013314 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.013560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.013712 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.013866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.014013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.014157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.014300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.014463 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.014625 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.014625 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.014923 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.015078 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.015267 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.015423 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.016628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.016628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.016960 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.017115 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.017270 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.017518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.017890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.017890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.018187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.018335 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 11:03:19.018488 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.018488 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.018792 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.018947 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.019100 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.019266 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.019420 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.019573 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.019725 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.019924 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.020077 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.020232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.020379 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.020522 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.020676 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.020875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.021031 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.021183 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.021329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.021473 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.021625 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.021779 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.021925 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.022069 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.022212 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.022364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.022533 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.022953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.023101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.023245 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.023396 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.023542 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.023700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.024046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.024225 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.024375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.024521 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.024699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.024872 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.025030 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.025176 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.025326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.025471 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.025616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.025770 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.025915 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.025915 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.026199 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.026367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.026967 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.027130 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.027330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.027511 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.027932 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.028107 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.028270 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.028416 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.028416 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.028694 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.028838 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.028990 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.029157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.029314 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.029460 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.029612 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.029778 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.029924 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.030078 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.030232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.030378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.030530 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.030686 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.030890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.031042 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.031187 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.031968 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.032138 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.032293 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.032463 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.032616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.032755 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.032853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.032941 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.033029 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.033129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.033226 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.033318 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.033411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.033504 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.033596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.033759 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.033849 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.033931 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034011 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034083 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034163 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034236 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034308 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034540 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034768 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034854 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.034928 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035007 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035091 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035180 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035396 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035625 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035697 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035767 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.035994 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.036105 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.036200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.036288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.036372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.036463 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.036549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.037108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.037210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.037296 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.037390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.037475 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.037568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.037668 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.037775 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.037861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.037946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.038300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.038390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.038485 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.038586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.038586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.038752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.038752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.038752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.038752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.038752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.039156 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.039245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.039330 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.039430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.039517 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.039608 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.039693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.039784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.039888 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.039994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040607 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040693 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040778 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.040905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041086 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041256 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041521 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041608 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041608 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041844 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.041844 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042481 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042568 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042568 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042568 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042568 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.042914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.043066 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.043229 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.043541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.043641 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.043894 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.044160 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.044266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.044532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.044730 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.044831 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.045184 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.045285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.045530 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.045774 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.045875 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.046178 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.046342 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.046501 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.047241 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.047353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.047451 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.047601 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.047695 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.047957 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.048344 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.048466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.048601 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.048834 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.048943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.049237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.049447 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.049549 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.049898 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.050005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.050203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.050515 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.050620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.050835 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.051125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.051234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.051495 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.051735 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.051830 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.052184 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.052378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.052515 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.052835 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.052936 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.053160 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.053468 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.053562 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.053784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.054051 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.054146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.054462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.054749 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.054915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.055023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.055269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.055376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.055727 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.055957 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.056109 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.056285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.056586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.056744 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.056932 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.057723 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.057829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.057935 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.058032 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.058128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.058570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.058570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.058767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.058933 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.058933 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.059200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.059398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.059815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.060010 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.060161 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.060402 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.060496 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.060795 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.060976 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.061196 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.061424 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.061561 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.061751 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.062075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.062167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.062402 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.063326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.063422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.063929 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.064030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.064445 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.064551 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.065465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.065579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.065579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.065758 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.065891 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.065996 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.066390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.066551 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.066906 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.067100 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.067416 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.067885 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.067995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.068259 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.068466 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.068800 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.068980 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.069338 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.069432 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.069874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.069978 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.070396 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.070500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.071160 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.071272 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.071361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.071521 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.071894 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.072098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.072406 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.072677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.072928 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.073206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.073438 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.073735 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.073963 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.074313 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.074464 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.074883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.074989 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.075382 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.075475 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.075891 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.076047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.076409 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.076596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.076933 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.077165 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.077440 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.077962 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.078109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.078940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.079056 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.079389 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.079483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.079913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.080033 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.080579 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.080785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.081146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.081327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.081698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.081802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.082235 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.082328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.082760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.082864 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.083271 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.083432 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.083809 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.084061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.084352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.084614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.084888 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.085185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.085389 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.085775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.085882 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.086285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.086702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.086795 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.087196 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.087547 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.087668 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.088071 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.088183 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.088596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.088704 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.089094 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.089202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.089585 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.089723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.090081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.090285 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.090584 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.090871 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.091085 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.091420 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.091609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.091991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.092122 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.092549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.092651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.093044 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.093138 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.093550 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.093687 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.094112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.094301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.094618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.094884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.095137 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.095443 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.095637 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.096421 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.096554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.096554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.096729 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.096994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.097170 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.097483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.097728 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.098192 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.098312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.099351 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.099466 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.099466 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.099628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.099713 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.099808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.100154 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.100317 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.100654 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.100889 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.101169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.101510 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.101672 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.102085 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.102206 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.102574 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.102684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.103101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.103207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.103604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.103706 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.104123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.104277 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.104639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.104793 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.105138 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.105376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.105646 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.105958 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.106146 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.106571 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.106663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.107067 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.107169 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.107561 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.107801 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.108108 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.108437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.108606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.108814 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.109169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.109578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.109780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.109984 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.110295 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.110559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.110798 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.111132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.111319 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.111698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.111809 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.112225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.112329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.112718 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.112812 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.113211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.113385 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.113728 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.113979 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.114228 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.114515 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.114765 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.115077 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.115270 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.115639 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.115741 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.116173 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.116270 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.116667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.116799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.117163 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.117324 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.117664 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.117853 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.118192 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.118322 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.118866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.118983 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.119273 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.119391 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.119745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.119873 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.120204 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.120384 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.120709 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.120909 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.121308 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.121418 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.121675 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.121868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.122009 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.122321 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.122417 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.122639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.122790 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.122958 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.123251 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.123354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.123584 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.123732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.123946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.124268 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.124375 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.124585 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.124747 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.125429 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.125789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.125885 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.126151 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.126245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.126468 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.126677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.126838 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.127129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.127232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.127466 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.127559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.127799 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.128047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.128144 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.128451 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.128731 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.128823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.129016 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.129118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.129386 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.129589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.129749 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.130005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.130127 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.130315 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.130500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.130624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.130945 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.131047 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.131258 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.131411 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.131573 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.131900 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.132000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.132247 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.132377 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.132580 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.132795 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.132938 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.133193 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.133287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.133509 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.133674 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.133823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.134126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.134219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.134462 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.134661 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.134831 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.135073 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.135173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.135390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.135618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.135758 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.136032 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.136139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.136347 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.136560 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.136652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.136975 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.137171 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.137338 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.137588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.137698 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.137902 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.138130 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.138238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.138517 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.138637 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.138872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.139092 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.139198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.139439 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.139584 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.139917 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.140202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.140306 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.140511 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.140673 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.141452 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.141839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.141962 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.142077 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.142187 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.142401 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.142633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.142727 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.143017 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.143116 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.143474 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.143620 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.143952 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.144447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.144692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.145003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.145088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.145331 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.145553 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.145647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.145948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.146115 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.146270 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.146604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.146893 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.146973 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.147214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.147311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.147526 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.148051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.148173 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.148504 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.148601 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.148766 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.149141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.149237 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.149499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.149750 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.149878 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.150443 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.150557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.150835 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.151163 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.151495 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.151804 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.151946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.152145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.152404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.152486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.152766 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.153191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.153300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.153478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.153573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.153738 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.154061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.154249 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.154421 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.154652 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.154835 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.155008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.155221 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.155390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.155618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.155781 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.156298 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.156465 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.156781 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.156948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.157116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.157347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.157517 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.157741 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.157923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.158092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.158357 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.158515 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.158676 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.158969 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.159139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.159297 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.159522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.159688 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.159922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.160104 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.160278 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.160542 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.160688 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.160848 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.161133 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.161318 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.161474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.161728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.161905 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.162074 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.162369 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.162540 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.162697 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.162986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.163191 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.163370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.163557 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.163732 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.163945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.164174 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.164339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.164561 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.164721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.164876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.165170 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.165332 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.165496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.165784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.165949 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.166127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.166350 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.166500 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.166790 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.166969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.167128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.167432 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.167592 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.167760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.168101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.168266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.168422 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.168668 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.168833 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.169040 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.169213 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.169459 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.169627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.169791 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.169957 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.170240 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.170423 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.170608 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.170839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.170969 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.171150 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.171373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.171480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.171751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.171967 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.172204 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.172364 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.172529 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.172757 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.172852 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.173085 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.173322 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.173426 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.173696 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.173796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.174010 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.174226 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.174320 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.174660 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.174823 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.174970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.175280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.175427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.175601 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.175765 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.175955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.176281 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.176374 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.176602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.176817 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.176919 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.177227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.177326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.177546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.177725 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.177865 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.178183 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.178282 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.178497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.178663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.178825 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.179146 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.179337 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.179504 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.179739 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.180038 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.180263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.180457 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.180689 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.180937 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.181103 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.181277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.181448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.181625 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.181890 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.182004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.182206 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.182466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.182559 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.182823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.182924 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.183138 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.183374 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.183529 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.183781 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.183902 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.184140 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.184271 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.184486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.184750 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.184854 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.185116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.185347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.185441 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.185739 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.185831 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.186101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.186230 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.186420 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.186705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.186805 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.187038 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.187175 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.187357 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.188265 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.188354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.188595 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.188774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.189007 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.189230 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.189325 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.189635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.189733 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.189953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.190143 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.190260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.190572 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.190702 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.190947 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.191175 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.191283 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.191528 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.191620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.191873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.192150 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.192255 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.192497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.192617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.192819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.193072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.193344 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.193542 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.193666 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.193998 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.194090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.194327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.194427 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.194657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.194893 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.194996 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.195297 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.195403 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.195631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.195794 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.195982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.196281 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.196383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.196600 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.196778 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.196916 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.197206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.197299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.197541 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.197643 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.197859 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.198080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.198172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.198478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.198580 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.198792 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.198939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.199329 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.199443 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.199699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.199935 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.200117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.200384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.200576 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.200753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.201018 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.201147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.201332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.201580 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.201684 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.201953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.202046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.202266 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.202511 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.202606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.202886 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.202977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.203900 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.204079 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.204236 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.204578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.204712 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.204859 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.205036 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.205162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.205472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.205566 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.205782 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.205922 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.206109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.206369 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.206462 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.206713 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.206810 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.207022 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.207242 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.207336 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.207636 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.207734 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.207970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.208142 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.208281 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.208589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.208689 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.208905 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.209006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.209224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.209515 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.209692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.209921 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.210032 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.210234 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.210494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.210596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.210895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.211000 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.211203 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.211512 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.211633 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.211824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.212043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.212138 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.212462 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.212567 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.212774 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.212915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.213118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.213385 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.213496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.213714 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.213890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.214063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.214333 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.214427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.214777 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.214913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.215224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.215325 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.215566 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.215672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.215924 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.216243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.216392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.216560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.216742 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.216871 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.217179 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.217272 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.217508 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.217648 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.217822 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.218106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.218209 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.218439 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.218562 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.218838 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.219052 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.219146 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.219458 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.219564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.219880 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.219995 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.220113 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.220427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.220533 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.220742 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.220900 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.221097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.221358 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.221671 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.221824 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.221982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.222288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.222403 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.222635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.222754 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.222954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.223196 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.223297 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.223578 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.223670 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.223948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.224113 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.224230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.224542 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.224655 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.224859 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.225062 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.225172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.225487 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.225587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.225823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.225927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.226142 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.226369 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.226462 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.226806 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.226908 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.227171 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.227263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.227494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.227717 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.227811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.228198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.228302 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.228577 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.228668 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.228912 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.229088 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.229227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.229548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.229656 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.229858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.230013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.230226 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.230530 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.230624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.230866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.230983 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.231197 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.231448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.231559 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.231801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.231975 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.232132 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.232436 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.232543 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.232756 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.232915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.233067 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.233382 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.233494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.233678 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.233899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.234042 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.234325 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.234494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.234635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.234928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.235022 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.235241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.235392 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.235552 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.235861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.235959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.236171 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.236345 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.236477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.236783 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.236894 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.237087 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.237308 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.237403 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.237692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.237792 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.237998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.238275 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.238368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.238598 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.238736 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.238905 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.239196 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.239288 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.239532 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.239722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.239893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.240226 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.240559 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.240736 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.240915 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.241177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.241344 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.241523 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.241803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.241945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.242206 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.242323 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.242425 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.242721 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.242837 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.243059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.243244 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.243392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.243664 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.243812 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.244000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.244205 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.244311 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.244612 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.244715 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.244926 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.245072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.245260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.245524 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.245617 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.245881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.245981 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.246211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.246404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.246531 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.246856 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.246951 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.247173 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.247317 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.247487 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.247794 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.247927 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.248146 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.248396 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.248508 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.248758 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.248852 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.249072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.249385 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.249562 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.249705 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.250569 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.250750 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.250954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.251144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.251229 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.251495 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.251719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.251816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.252169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.252291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.252492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.252715 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.252825 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.253135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.253237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.253486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.253676 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.253802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.254120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.254273 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.254469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.254600 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.254786 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.255066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.255224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.255377 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.255516 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.255653 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 11:03:19.255944 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.256341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.256738 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.257131 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.257523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.257915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.258303 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.258710 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.259096 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.259486 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.259952 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.260355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.260804 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.261194 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.261588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.262015 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.262422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.262809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.263347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.263740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.264166 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.264600 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.264994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.265379 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.266466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.266865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.267252 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.267653 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.268090 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.268510 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.268906 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.269301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.269787 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.270231 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.270907 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.271327 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.271739 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.272223 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.272644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.273394 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.273796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.274193 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.274614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.275016 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.275418 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.275817 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.276245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.276629 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.277023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.277417 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.277808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.278199 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.278592 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.278984 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.279383 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.279775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.280257 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.280658 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.281144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.281577 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.281995 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.282450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.282883 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.283349 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.283776 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.284202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.284604 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.285019 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.285438 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.285839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.286234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.286750 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.287148 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.287557 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.288003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.288401 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.288809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.289218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.289613 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.290026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.290494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.290912 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.291401 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.291854 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.292391 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.292897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.293381 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.293840 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.294239 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.294641 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.295033 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.295426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.295811 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.296233 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.296620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.297038 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.297428 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.297810 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.298202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.298585 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.298971 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.299355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.299739 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.300149 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.300542 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.300934 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.301377 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.301770 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.302156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.302603 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.303053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.303477 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.304098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.304601 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.305011 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.305411 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.305903 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.306367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.306832 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.307290 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.307747 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.308222 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.308699 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.309151 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.309600 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.310046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.310674 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.311093 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.311564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.312082 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.313364 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.313659 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.314075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.314517 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.314944 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.315346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.315740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.316206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.316608 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.317003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.317393 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.317789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.318190 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.318384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Registered counter for database nova_api Oct 06 11:03:19.318642 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.319035 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.319428 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.319828 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.320425 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.320941 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.321450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.321810 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.322232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.322644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.323081 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.323616 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.324137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.324643 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.325062 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.325462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.325854 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 11:03:19.326172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 11:03:19.338939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 11:03:19.345866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 11:03:19.389585 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO dbcounter [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Registered counter for database nova_api Oct 06 11:03:19.401817 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.context [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64583f48-9147-4152-987f-d1b239ba1ce3(cell1) {{(pid=120603) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 11:03:19.405824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:03:19.406378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:03:19.408018 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:03:19.408758 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:03:19.409207 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:03:19.410639 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_db.sqlalchemy.engines [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 11:03:19.411245 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:03:19.413372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Registered counter for database nova_cell0 Oct 06 11:03:19.417363 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writer thread running {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 11:03:19.417482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Registered counter for database nova_cell1 Oct 06 11:03:19.425742 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 11:03:19.428019 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 11:03:19.432991 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 11:03:19.435599 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 11:03:19.473809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.context [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64583f48-9147-4152-987f-d1b239ba1ce3(cell1) {{(pid=120602) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 11:03:19.477801 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:03:19.478280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:03:19.479905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:03:19.480639 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:03:19.481090 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:03:19.483102 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:03:19.485819 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO dbcounter [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Registered counter for database nova_cell0 Oct 06 11:03:19.489791 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO dbcounter [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Registered counter for database nova_cell1 Oct 06 11:03:19.496888 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_db.sqlalchemy.engines [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 11:03:19.499047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_db.sqlalchemy.engines [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 11:03:19.504740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writer thread running {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 11:03:19.507353 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writer thread running {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 11:03:19.583856 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Registered counter for database nova_cell0 Oct 06 11:03:19.590500 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 11:03:19.596046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 11:03:19.655610 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO dbcounter [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Registered counter for database nova_cell0 Oct 06 11:03:19.663207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_db.sqlalchemy.engines [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 11:03:19.667595 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writer thread running {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 11:03:19.918899 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 11:03:19.926970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 11:03:19.990075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: WARNING keystonemiddleware.auth_token [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 11:03:19.997418 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: WARNING keystonemiddleware.auth_token [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 11:03:20.278653 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 11:03:20.285020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-af7f0d90-9bdc-41b7-aff9-c3ed54de9444 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 11:03:20.290300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea60d969c0 pid: 120603 (default app) Oct 06 11:03:20.347980 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: WARNING keystonemiddleware.auth_token [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 11:03:20.354008 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: WARNING keystonemiddleware.auth_token [None req-301bf992-3441-4d5d-a711-330be5aacc9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 11:03:20.359338 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea60d969c0 pid: 120602 (default app) Oct 06 11:03:56.338126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:56.339599 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:56.340878 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:56.341749 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:57.658908 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ddc43d6-764f-469d-8247-ac5db7cfa31f tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] Action: 'create', calling method: .version_select at 0x7f92a7e1b4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1897801762", "metadata": {"Type": "work"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:03:58.659346 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ddc43d6-764f-469d-8247-ac5db7cfa31f tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.335106 Oct 06 11:03:58.660926 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Thu Oct 6 11:03:56 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2338 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 06 11:03:59.038947 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9d911df-cf62-4307-a9d4-df3fc3d4659a tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] Calling method '.version_select at 0x7f92a7ea70d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:03:59.091287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:59.093369 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:59.094523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:59.095292 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:59.413457 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9d911df-cf62-4307-a9d4-df3fc3d4659a tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0" status: 200 len: 353 microversion: 2.1 time: 0.736012 Oct 06 11:03:59.414539 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:03:58 2022] GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0 => generated 353 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:00.315124 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d78573c9-f908-4294-9539-f5bd6722ae3f tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a7cf03a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:00.426301 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d78573c9-f908-4294-9539-f5bd6722ae3f tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/9c31dbb7-5372-4408-88be-569800efdffe" status: 200 len: 351 microversion: 2.1 time: 0.117621 Oct 06 11:04:00.427117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:04:00 2022] GET /compute/v2.1/os-volumes/9c31dbb7-5372-4408-88be-569800efdffe => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:00.430821 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b012e13-bd82-4e15-9a19-597b327513d3 tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] Calling method '.version_select at 0x7f92a7cde3a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:01.115828 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b012e13-bd82-4e15-9a19-597b327513d3 tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0" status: 200 len: 354 microversion: 2.1 time: 0.691192 Oct 06 11:04:01.116878 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:04:00 2022] GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0 => generated 354 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:04:01.131897 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9e0d397-8b9d-420f-a697-28a643d71672 tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] Calling method '.version_select at 0x7f92a7cf0af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:01.313168 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9e0d397-8b9d-420f-a697-28a643d71672 tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0" status: 200 len: 354 microversion: 2.1 time: 0.186391 Oct 06 11:04:01.326963 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:04:01 2022] GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0 => generated 354 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:01.333829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5edef1f5-20a9-48ab-b42c-556e7acec2a2 tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] Calling method '.version_select at 0x7f92a7cde430>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:01.519248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5edef1f5-20a9-48ab-b42c-556e7acec2a2 tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0" status: 202 len: 0 microversion: 2.1 time: 0.189665 Oct 06 11:04:01.521014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Oct 6 11:04:01 2022] DELETE /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 11:04:01.529938 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72adf68c-4f95-4318-a8c5-45db9172c24a tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] Calling method '.version_select at 0x7f92a7c891f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:01.631314 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72adf68c-4f95-4318-a8c5-45db9172c24a tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0" status: 200 len: 353 microversion: 2.1 time: 0.105680 Oct 06 11:04:01.638533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:04:01 2022] GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:02.648844 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cd21fa22-50cd-49c3-9b37-997a122573c9 tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] Calling method '.version_select at 0x7f92a7cdeb80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:02.816531 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cd21fa22-50cd-49c3-9b37-997a122573c9 tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0" status: 200 len: 353 microversion: 2.1 time: 0.165677 Oct 06 11:04:02.817296 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:04:02 2022] GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:03.442332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5bdf68ef-9802-4977-8940-260b2d58b17a tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a7cf0c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:03.544977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5bdf68ef-9802-4977-8940-260b2d58b17a tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d7dc00fb-223e-4124-8d9b-f6cb142b224c" status: 200 len: 350 microversion: 2.1 time: 0.106717 Oct 06 11:04:03.545550 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 5/9] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:04:03 2022] GET /compute/v2.1/os-volumes/d7dc00fb-223e-4124-8d9b-f6cb142b224c => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:03.832723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7296495e-f0ed-4cf6-8176-ef83d950b9fd tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] Calling method '.version_select at 0x7f92a7cf4280>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:03.932526 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-7296495e-f0ed-4cf6-8176-ef83d950b9fd tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] HTTP exception thrown: Volume 40ee52d7-aef3-4347-abc8-d3e03a5d61f0 could not be found. Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7296495e-f0ed-4cf6-8176-ef83d950b9fd tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] Request method failure captured: Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0 HTTP/1.1 Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYc_-854aGvPgcvqiWHMStn1XcM_2mKVjKAokiirvvyTRek0IKijWY1JWkS9e94lhr9Uwu1GFfT5mNka-8ogp4CM0ClUCwHCn_9iTT54JiESpo7Ljznzu-k2BuYUrBhDFVdudw1E9oxDxUAoaTXL21KWzrlX8B2FOTI1PG_XfMGEbU Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 69b37e6e45a4446093bd3bd7b3524a67 Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesGetTestJSON-1776160914 Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:04:03.939120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69b37e6e45a4446093bd3bd7b3524a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69b37e6e45a4446093bd3bd7b3524a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69b37e6e45a4446093bd3bd7b3524a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69b37e6e45a4446093bd3bd7b3524a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-VolumesGetTestJSON-1776160914 Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 69b37e6e45a4446093bd3bd7b3524a67 Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesGetTestJSON-1776160914 Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-VolumesGetTestJSON-1776160914-project Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 617e3cd4a7f84e629d724160a6dcde61 Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-VolumesGetTestJSON-1776160914-project Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Volume 40ee52d7-aef3-4347-abc8-d3e03a5d61f0 could not be found. Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '40ee52d7-aef3-4347-abc8-d3e03a5d61f0'} Oct 06 11:04:03.940757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40ee52d7-aef3-4347-abc8-d3e03a5d61f0 could not be found. (HTTP 404) (Request-ID: req-3f446cea-6c88-4a37-87fc-d0f2aa19cee0) Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:04:03.941773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 11:04:03.942904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40ee52d7-aef3-4347-abc8-d3e03a5d61f0 could not be found. Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 11:04:03.945586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40ee52d7-aef3-4347-abc8-d3e03a5d61f0 could not be found. Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40ee52d7-aef3-4347-abc8-d3e03a5d61f0 could not be found. Oct 06 11:04:03.946737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:04:03.948275 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7296495e-f0ed-4cf6-8176-ef83d950b9fd tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] Returning 404 to user: Volume 40ee52d7-aef3-4347-abc8-d3e03a5d61f0 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:04:03.949554 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7296495e-f0ed-4cf6-8176-ef83d950b9fd tempest-VolumesGetTestJSON-1776160914 tempest-VolumesGetTestJSON-1776160914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0" status: 404 len: 109 microversion: 2.1 time: 0.122854 Oct 06 11:04:03.951423 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 5/10] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:04:03 2022] GET /compute/v2.1/os-volumes/40ee52d7-aef3-4347-abc8-d3e03a5d61f0 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 11:04:05.424125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-668e39d0-3ff7-478d-8459-889accff92f7 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a7cf05e0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:05.523518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-668e39d0-3ff7-478d-8459-889accff92f7 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/be5a414c-14b8-41f2-a7cb-8425b38e3268" status: 200 len: 351 microversion: 2.1 time: 0.103720 Oct 06 11:04:05.524632 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:04:05 2022] GET /compute/v2.1/os-volumes/be5a414c-14b8-41f2-a7cb-8425b38e3268 => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:05.539829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-502a2116-63a9-4567-b2b7-dc9dab609e7a tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a7cf4b80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:05.714939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-502a2116-63a9-4567-b2b7-dc9dab609e7a tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.179559 Oct 06 11:04:05.716002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1134 bytes} [Thu Oct 6 11:04:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:05.732903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d87645ae-f7af-4d6b-9ac9-974a97635c60 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a7c893a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:05.914948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d87645ae-f7af-4d6b-9ac9-974a97635c60 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.188328 Oct 06 11:04:05.915661 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1149 bytes} [Thu Oct 6 11:04:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:05.929934 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8bc2d828-fca8-474b-a911-bf14cf4fbfba tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a8649940>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:06.083882 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8bc2d828-fca8-474b-a911-bf14cf4fbfba tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.157893 Oct 06 11:04:06.085012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 7/14] 10.222.0.52 () {58 vars in 1134 bytes} [Thu Oct 6 11:04:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:06.099766 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-860b61a9-b341-4f23-8f3a-16907a849cf1 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a7cf0430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:06.260744 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-860b61a9-b341-4f23-8f3a-16907a849cf1 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.165656 Oct 06 11:04:06.261370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 8/15] 10.222.0.52 () {58 vars in 1167 bytes} [Thu Oct 6 11:04:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:06.276154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8811c900-2fc3-4f85-bfbc-cd1f3da8e181 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a7c668b0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:06.495990 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8811c900-2fc3-4f85-bfbc-cd1f3da8e181 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.224553 Oct 06 11:04:06.496893 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1170 bytes} [Thu Oct 6 11:04:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:04:06.511724 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72d91927-70da-49be-bed8-81356dc5e3d6 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a7c898b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:06.679276 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72d91927-70da-49be-bed8-81356dc5e3d6 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.172156 Oct 06 11:04:06.694918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2fea2287-c634-4405-b39f-aa0c64089b30 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a7c66790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:06.698260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 9/17] 10.222.0.52 () {58 vars in 1155 bytes} [Thu Oct 6 11:04:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:06.933948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2fea2287-c634-4405-b39f-aa0c64089b30 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.243438 Oct 06 11:04:06.934523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 9/18] 10.222.0.52 () {58 vars in 1188 bytes} [Thu Oct 6 11:04:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:06.950472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9431117-45d5-4e62-b962-52dbe720dc64 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] Calling method '.version_select at 0x7f92a7c95940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:07.118325 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9431117-45d5-4e62-b962-52dbe720dc64 tempest-VolumesTestJSON-1222885395 tempest-VolumesTestJSON-1222885395-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.173974 Oct 06 11:04:07.119553 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 10/19] 10.222.0.52 () {58 vars in 1155 bytes} [Thu Oct 6 11:04:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:12.556305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c7fa1b1-21fb-4081-a0c4-6b13edd25486 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'create', calling method: .version_select at 0x7f92a7c55af0>, body: {"keypair": {"name": "tempest-keypair-462469057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9DtO1s7X99cUn11tQ7FF1TjNvbbE3igoiHsY/E6i/iubclkfh/9QoXPAYlUUZrTvVsx5MBRbUGraGSAXfHx5aQoTKzC45l/QXvPr3AMGOpcrrZqZr++J3ce8QN5jwyBw=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:12.623169 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-7c7fa1b1-21fb-4081-a0c4-6b13edd25486 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Getting quotas for project 8c9bfd4947d045cf831f1a60bf91f389. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:04:12.630249 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-7c7fa1b1-21fb-4081-a0c4-6b13edd25486 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Getting quotas for user 1bb1115590ac45fdbcdc6d3f52aa6921 and project 8c9bfd4947d045cf831f1a60bf91f389. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:04:12.745554 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c7fa1b1-21fb-4081-a0c4-6b13edd25486 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.996144 Oct 06 11:04:12.758920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Oct 6 11:04:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:13.548449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ca81fa4-567a-417f-8b88-d69af3782e8f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Action: 'create', calling method: .version_select at 0x7f92a7c89dc0>, body: {"keypair": {"name": "tempest-keypair-970010329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf6LwWwqJwcyiWsMcvyJsMPqO2MBIO+ymy9F9bzYKthcQKVp8C1G8Rfvq/AzVId5Np4ikhkVWVuGTOGCNcS0JPSYK9Lsk6YPwfJa8zOfv7g0duvGL3/SVpm2ALLcGTrRQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:13.670961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-9ca81fa4-567a-417f-8b88-d69af3782e8f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Getting quotas for project 5b886dc365684ab1811d100eb5774619. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:04:13.691827 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-9ca81fa4-567a-417f-8b88-d69af3782e8f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Getting quotas for user 56835f0c8dc0416d9fa70662e40c856d and project 5b886dc365684ab1811d100eb5774619. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:04:13.788124 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ca81fa4-567a-417f-8b88-d69af3782e8f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.498204 Oct 06 11:04:13.789563 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 11/21] 10.222.0.52 () {62 vars in 1200 bytes} [Thu Oct 6 11:04:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 500 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 11:04:15.265762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1985027214", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:15.518570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] validate_networks() for [('66a88666-ebf0-4b86-a615-d5110a6e14c5', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:04:17.096557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-883000441", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "networks": [{"uuid": "84fb2e44-ffdd-44a0-80d5-3b7dac4d9b36"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:17.312993 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] validate_networks() for [('84fb2e44-ffdd-44a0-80d5-3b7dac4d9b36', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:04:18.638723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:04:18.639371 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:04:18.640460 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:04:18.641132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:04:18.641651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:04:18.678557 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:18.679286 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:18.679883 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:18.680755 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:18.681362 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:18.682027 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:18.727485 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Getting quotas for project 4ebb258de32f40c68f86e4b401efde5d. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:04:18.742329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Getting quotas for user f1815cf2b3f347eb8276769cc30cf116 and project 4ebb258de32f40c68f86e4b401efde5d. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:04:18.777565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:04:18.793447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:04:18.944071 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9ba6eddd-3c0e-4710-a28b-27cc634f437a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.473063 Oct 06 11:04:18.945564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 11/22] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:04:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 4475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:04:18.962784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20b5aac3-c1e8-4eee-ba57-361987bd1cb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:18.963793 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-20b5aac3-c1e8-4eee-ba57-361987bd1cb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:19.263264 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-20b5aac3-c1e8-4eee-ba57-361987bd1cb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:19.291032 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-20b5aac3-c1e8-4eee-ba57-361987bd1cb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1222 microversion: 2.1 time: 0.333807 Oct 06 11:04:19.292417 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:18 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1222 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:19.310676 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-484983724", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fea6c97c-9c48-403d-929b-bfa5008b2a1f"}], "security_groups": [{"name": "tempest-securitygroup--1157006524"}], "key_name": "tempest-keypair-462469057", "user_data": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:19.600272 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] validate_networks() for [('fea6c97c-9c48-403d-929b-bfa5008b2a1f', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:04:20.564254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:04:20.564853 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:04:20.565062 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:04:20.565474 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:04:20.565884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:04:20.584695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:20.585761 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:20.586210 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:20.587025 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:20.587571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:20.592468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:20.632945 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Getting quotas for project 8c9bfd4947d045cf831f1a60bf91f389. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:04:20.645409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Getting quotas for user 1bb1115590ac45fdbcdc6d3f52aa6921 and project 8c9bfd4947d045cf831f1a60bf91f389. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:04:20.668296 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:04:20.671947 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:04:20.793250 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e6f0a49-d808-4f6b-aa4d-1c02fac69c94 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.499084 Oct 06 11:04:20.800854 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 13/24] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:04:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:04:20.801509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-412703012", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:20.914686 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] validate_networks() for [('66a88666-ebf0-4b86-a615-d5110a6e14c5', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:04:21.907061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:04:21.907641 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:04:21.908009 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:04:21.908419 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:04:21.908829 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:04:21.934615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:21.935958 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:21.940461 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:21.943413 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:21.944910 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:21.946200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:22.005326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Getting quotas for project aaa6c50978eb46ecba4c88562ede965b. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:04:22.020466 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Getting quotas for user 02930aebe31e450f9fc989af369bf319 and project aaa6c50978eb46ecba4c88562ede965b. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:04:22.050277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:04:22.055586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:04:22.284712 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c735ec5-457a-49fb-ac53-e3dc0e35343c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.921626 Oct 06 11:04:22.296773 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 12/25] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:04:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 5934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 11:04:22.313541 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1896122724", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f38c588e-4101-4e6e-967d-e0ae7e6cf8d1"}], "security_groups": [{"name": "tempest-securitygroup--218946242"}], "key_name": "tempest-keypair-970010329", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:22.558504 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:04:22.559793 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:04:22.560484 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:04:22.561080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:04:22.562284 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:04:22.615018 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:22.617157 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:22.617849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:22.627469 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:22.631994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:22.632823 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:22.666031 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Getting quotas for project 4ebb258de32f40c68f86e4b401efde5d. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:04:22.672836 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Getting quotas for user f1815cf2b3f347eb8276769cc30cf116 and project 4ebb258de32f40c68f86e4b401efde5d. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:04:22.692608 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:04:22.698391 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:04:22.857608 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fc58c9f3-c892-40f3-8ba4-ae93c126c8b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.059137 Oct 06 11:04:22.862233 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 14/26] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:04:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:04:22.875189 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61f99284-3904-4ffa-9f25-e37cd199bbeb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:22.878555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-61f99284-3904-4ffa-9f25-e37cd199bbeb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:22.906795 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61f99284-3904-4ffa-9f25-e37cd199bbeb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:22.907305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61f99284-3904-4ffa-9f25-e37cd199bbeb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:22.908223 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61f99284-3904-4ffa-9f25-e37cd199bbeb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:22.909094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61f99284-3904-4ffa-9f25-e37cd199bbeb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:22.910116 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61f99284-3904-4ffa-9f25-e37cd199bbeb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:22.910864 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61f99284-3904-4ffa-9f25-e37cd199bbeb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:22.970842 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] validate_networks() for [('f38c588e-4101-4e6e-967d-e0ae7e6cf8d1', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:04:23.327659 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-61f99284-3904-4ffa-9f25-e37cd199bbeb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:23.377073 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61f99284-3904-4ffa-9f25-e37cd199bbeb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1232 microversion: 2.1 time: 0.512373 Oct 06 11:04:23.378569 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 15/27] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:22 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1232 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:23.408571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57442839-be5f-4637-bbbd-81a8561c2969 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:23.409385 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57442839-be5f-4637-bbbd-81a8561c2969 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:23.795780 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-57442839-be5f-4637-bbbd-81a8561c2969 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:23.822519 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57442839-be5f-4637-bbbd-81a8561c2969 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1214 microversion: 2.1 time: 0.416910 Oct 06 11:04:23.828233 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 16/28] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:23 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1214 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:23.840039 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ad9f8505-6672-46ee-b4c6-55fdf482a85e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:23.847621 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ad9f8505-6672-46ee-b4c6-55fdf482a85e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:23.985095 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ad9f8505-6672-46ee-b4c6-55fdf482a85e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:23.999513 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ad9f8505-6672-46ee-b4c6-55fdf482a85e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1221 microversion: 2.1 time: 0.159911 Oct 06 11:04:24.016939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 17/29] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:23 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1221 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:24.404301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fdbc3ab5-12b6-4277-863a-f4219ac9addd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:24.405813 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fdbc3ab5-12b6-4277-863a-f4219ac9addd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:24.433325 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdbc3ab5-12b6-4277-863a-f4219ac9addd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:24.437289 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdbc3ab5-12b6-4277-863a-f4219ac9addd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:24.447309 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdbc3ab5-12b6-4277-863a-f4219ac9addd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:24.452744 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdbc3ab5-12b6-4277-863a-f4219ac9addd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:24.460817 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdbc3ab5-12b6-4277-863a-f4219ac9addd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:24.465148 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdbc3ab5-12b6-4277-863a-f4219ac9addd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:24.798244 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-fdbc3ab5-12b6-4277-863a-f4219ac9addd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:24.830263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fdbc3ab5-12b6-4277-863a-f4219ac9addd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1296 microversion: 2.1 time: 0.431197 Oct 06 11:04:24.853066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 18/30] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:24 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1296 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:24.873101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6472b2f9-22f3-434a-8d91-2f52018df125 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:24.878731 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6472b2f9-22f3-434a-8d91-2f52018df125 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:24.888286 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6472b2f9-22f3-434a-8d91-2f52018df125 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:24.890511 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6472b2f9-22f3-434a-8d91-2f52018df125 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:24.892321 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6472b2f9-22f3-434a-8d91-2f52018df125 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:24.893634 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6472b2f9-22f3-434a-8d91-2f52018df125 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:24.894390 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6472b2f9-22f3-434a-8d91-2f52018df125 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:24.895085 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6472b2f9-22f3-434a-8d91-2f52018df125 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:25.071214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:04:25.073160 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:04:25.074069 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:04:25.074922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:04:25.077572 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:04:25.097735 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:25.098533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:25.099208 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:25.100154 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:25.100831 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:25.101651 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:25.110684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6472b2f9-22f3-434a-8d91-2f52018df125 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:25.119893 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6472b2f9-22f3-434a-8d91-2f52018df125 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1266 microversion: 2.1 time: 0.264860 Oct 06 11:04:25.126817 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Getting quotas for project 5b886dc365684ab1811d100eb5774619. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:04:25.131148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Getting quotas for user 56835f0c8dc0416d9fa70662e40c856d and project 5b886dc365684ab1811d100eb5774619. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:04:25.133881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 19/31] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:24 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:25.146952 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:04:25.150079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:04:25.150925 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5dbbbd7-cb1c-4e16-82aa-7094e7d6f73f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:25.153285 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b5dbbbd7-cb1c-4e16-82aa-7094e7d6f73f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:25.179346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dbbbd7-cb1c-4e16-82aa-7094e7d6f73f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:25.179867 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dbbbd7-cb1c-4e16-82aa-7094e7d6f73f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:25.180348 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dbbbd7-cb1c-4e16-82aa-7094e7d6f73f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:25.181717 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dbbbd7-cb1c-4e16-82aa-7094e7d6f73f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:25.181830 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dbbbd7-cb1c-4e16-82aa-7094e7d6f73f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:25.182326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dbbbd7-cb1c-4e16-82aa-7094e7d6f73f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:25.254375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-90d5ef24-aa53-4a0a-a7f6-890599cfddcb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.954434 Oct 06 11:04:25.255635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 13/32] 10.222.0.52 () {62 vars in 1188 bytes} [Thu Oct 6 11:04:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 2958 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 11:04:25.269272 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8b0ea53-797e-49a1-85fc-e92998bbde55 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:25.270540 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8b0ea53-797e-49a1-85fc-e92998bbde55 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:25.419139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5dbbbd7-cb1c-4e16-82aa-7094e7d6f73f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:25.439735 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b5dbbbd7-cb1c-4e16-82aa-7094e7d6f73f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1217 microversion: 2.1 time: 0.304322 Oct 06 11:04:25.440905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 20/33] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:25 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1217 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:25.872418 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f55a28e-b487-49dc-a770-44b886f18d9f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:25.876565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f55a28e-b487-49dc-a770-44b886f18d9f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:25.908120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f55a28e-b487-49dc-a770-44b886f18d9f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:25.909637 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f55a28e-b487-49dc-a770-44b886f18d9f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:25.910856 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f55a28e-b487-49dc-a770-44b886f18d9f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:25.915685 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f55a28e-b487-49dc-a770-44b886f18d9f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:25.916422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f55a28e-b487-49dc-a770-44b886f18d9f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:25.918645 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f55a28e-b487-49dc-a770-44b886f18d9f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:25.969326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8b0ea53-797e-49a1-85fc-e92998bbde55 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:26.057516 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8b0ea53-797e-49a1-85fc-e92998bbde55 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:26.073813 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8b0ea53-797e-49a1-85fc-e92998bbde55 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:26.078893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b8b0ea53-797e-49a1-85fc-e92998bbde55 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1281 microversion: 2.20 time: 0.816281 Oct 06 11:04:26.081981 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 14/34] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:25 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1281 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:04:26.149344 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb4f61fb-e216-4407-82a6-a42e62f80903 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:26.152597 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb4f61fb-e216-4407-82a6-a42e62f80903 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:26.163968 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb4f61fb-e216-4407-82a6-a42e62f80903 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:26.172527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb4f61fb-e216-4407-82a6-a42e62f80903 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:26.176651 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb4f61fb-e216-4407-82a6-a42e62f80903 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:26.180420 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb4f61fb-e216-4407-82a6-a42e62f80903 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:26.184952 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb4f61fb-e216-4407-82a6-a42e62f80903 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:26.185767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb4f61fb-e216-4407-82a6-a42e62f80903 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:26.263049 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f55a28e-b487-49dc-a770-44b886f18d9f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:26.281513 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f55a28e-b487-49dc-a770-44b886f18d9f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1294 microversion: 2.1 time: 0.414725 Oct 06 11:04:26.282563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 21/35] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:25 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1294 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:26.469132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-397ee273-3d02-4186-97f2-39769c9c5fd2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:26.469969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-397ee273-3d02-4186-97f2-39769c9c5fd2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:26.497824 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ee273-3d02-4186-97f2-39769c9c5fd2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:26.504346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ee273-3d02-4186-97f2-39769c9c5fd2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:26.506767 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ee273-3d02-4186-97f2-39769c9c5fd2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:26.509063 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ee273-3d02-4186-97f2-39769c9c5fd2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:26.514115 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ee273-3d02-4186-97f2-39769c9c5fd2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:26.518876 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ee273-3d02-4186-97f2-39769c9c5fd2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:27.017136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-397ee273-3d02-4186-97f2-39769c9c5fd2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:27.047236 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-397ee273-3d02-4186-97f2-39769c9c5fd2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1273 microversion: 2.1 time: 0.576370 Oct 06 11:04:27.049868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 22/36] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:26 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1273 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:27.106681 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:27.107440 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:27.121251 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:27.123008 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:27.125201 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:27.130923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:27.131518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:27.132047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:27.663533 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:27.668766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:27.688380 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:27.692677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f046a09-2419-4be3-82a3-d9ea1afe0f1a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1277 microversion: 2.20 time: 0.590819 Oct 06 11:04:27.700991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 23/37] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:27 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1277 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:04:27.745543 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7837b218-dd08-4986-aeda-2ff69cf5e35d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:27.749202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7837b218-dd08-4986-aeda-2ff69cf5e35d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:27.776061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7837b218-dd08-4986-aeda-2ff69cf5e35d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:27.776582 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7837b218-dd08-4986-aeda-2ff69cf5e35d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:27.777022 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7837b218-dd08-4986-aeda-2ff69cf5e35d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:27.777748 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7837b218-dd08-4986-aeda-2ff69cf5e35d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:27.778201 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7837b218-dd08-4986-aeda-2ff69cf5e35d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:27.778630 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7837b218-dd08-4986-aeda-2ff69cf5e35d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:28.104230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bb4f61fb-e216-4407-82a6-a42e62f80903 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:28.128833 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb4f61fb-e216-4407-82a6-a42e62f80903 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1272 microversion: 2.1 time: 1.984817 Oct 06 11:04:28.144198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 15/38] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:26 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1272 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:28.159163 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ccebeff5-314c-4d6d-8273-d5d38580727b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:28.160161 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ccebeff5-314c-4d6d-8273-d5d38580727b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:28.168946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccebeff5-314c-4d6d-8273-d5d38580727b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:28.170818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccebeff5-314c-4d6d-8273-d5d38580727b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:28.171985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccebeff5-314c-4d6d-8273-d5d38580727b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:28.173226 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccebeff5-314c-4d6d-8273-d5d38580727b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:28.173917 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccebeff5-314c-4d6d-8273-d5d38580727b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:28.175446 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccebeff5-314c-4d6d-8273-d5d38580727b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:28.184677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7837b218-dd08-4986-aeda-2ff69cf5e35d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:28.197748 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7837b218-dd08-4986-aeda-2ff69cf5e35d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1294 microversion: 2.1 time: 0.490557 Oct 06 11:04:28.204823 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 24/39] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:27 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1294 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:28.424279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ccebeff5-314c-4d6d-8273-d5d38580727b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:28.435693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ccebeff5-314c-4d6d-8273-d5d38580727b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.288421 Oct 06 11:04:28.450026 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 16/40] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:28 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:28.729986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:28.730759 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:28.744362 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:28.748076 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:28.749782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:28.750758 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:28.751228 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:28.756126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:28.900160 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:28.916418 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:28.928053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:28.930541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84851121-a4ac-4594-afaa-e59d80dc3509 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.204291 Oct 06 11:04:28.942147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 25/41] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:28 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:29.161299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d69c31e-fbbe-49cc-ba13-caff5dc3c46e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:29.162524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d69c31e-fbbe-49cc-ba13-caff5dc3c46e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:29.170783 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d69c31e-fbbe-49cc-ba13-caff5dc3c46e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:29.171382 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d69c31e-fbbe-49cc-ba13-caff5dc3c46e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:29.172172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d69c31e-fbbe-49cc-ba13-caff5dc3c46e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:29.173097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d69c31e-fbbe-49cc-ba13-caff5dc3c46e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:29.173746 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d69c31e-fbbe-49cc-ba13-caff5dc3c46e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:29.175078 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d69c31e-fbbe-49cc-ba13-caff5dc3c46e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:29.227682 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-475d83f4-aa97-45bb-aa29-8397b216fe71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:29.228422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-475d83f4-aa97-45bb-aa29-8397b216fe71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:29.238097 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-475d83f4-aa97-45bb-aa29-8397b216fe71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:29.238585 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-475d83f4-aa97-45bb-aa29-8397b216fe71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:29.239016 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-475d83f4-aa97-45bb-aa29-8397b216fe71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:29.239711 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-475d83f4-aa97-45bb-aa29-8397b216fe71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:29.240816 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-475d83f4-aa97-45bb-aa29-8397b216fe71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:29.243232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-475d83f4-aa97-45bb-aa29-8397b216fe71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:29.265568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d69c31e-fbbe-49cc-ba13-caff5dc3c46e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:29.277131 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d69c31e-fbbe-49cc-ba13-caff5dc3c46e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1272 microversion: 2.1 time: 0.121724 Oct 06 11:04:29.294658 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 17/42] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:29 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:29.462350 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a296321d-54d8-434b-91c2-f9faab39cb3f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:29.463792 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a296321d-54d8-434b-91c2-f9faab39cb3f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:29.471555 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a296321d-54d8-434b-91c2-f9faab39cb3f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:29.472110 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a296321d-54d8-434b-91c2-f9faab39cb3f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:29.473483 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a296321d-54d8-434b-91c2-f9faab39cb3f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:29.474709 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a296321d-54d8-434b-91c2-f9faab39cb3f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:29.475308 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a296321d-54d8-434b-91c2-f9faab39cb3f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:29.475910 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a296321d-54d8-434b-91c2-f9faab39cb3f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:29.480766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-475d83f4-aa97-45bb-aa29-8397b216fe71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:29.490981 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-475d83f4-aa97-45bb-aa29-8397b216fe71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.266972 Oct 06 11:04:29.496864 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 26/43] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:29 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:29.581582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a296321d-54d8-434b-91c2-f9faab39cb3f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:29.604993 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a296321d-54d8-434b-91c2-f9faab39cb3f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.146110 Oct 06 11:04:29.605949 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 18/44] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:29 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:29.959017 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:29.959633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:29.969732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:29.970239 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:29.970679 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:29.971398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:29.973331 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:29.973771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:30.106643 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:30.119645 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:30.121174 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:30.122413 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49442a7c-83c4-4b3a-ab32-9c405dc0a43f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.167798 Oct 06 11:04:30.128096 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 27/45] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:29 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:30.304100 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-447b13cf-b788-4d52-912f-6f595153647c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:30.305280 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-447b13cf-b788-4d52-912f-6f595153647c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:30.313692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-447b13cf-b788-4d52-912f-6f595153647c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:30.314695 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-447b13cf-b788-4d52-912f-6f595153647c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:30.315548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-447b13cf-b788-4d52-912f-6f595153647c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:30.316428 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-447b13cf-b788-4d52-912f-6f595153647c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:30.317035 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-447b13cf-b788-4d52-912f-6f595153647c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:30.317665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-447b13cf-b788-4d52-912f-6f595153647c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:30.518137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b77a2062-3668-447a-a575-d91be4fafd81 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:30.518766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b77a2062-3668-447a-a575-d91be4fafd81 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:30.526946 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a2062-3668-447a-a575-d91be4fafd81 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:30.527456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a2062-3668-447a-a575-d91be4fafd81 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:30.527611 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-447b13cf-b788-4d52-912f-6f595153647c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:30.527929 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a2062-3668-447a-a575-d91be4fafd81 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:30.528726 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a2062-3668-447a-a575-d91be4fafd81 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:30.529190 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a2062-3668-447a-a575-d91be4fafd81 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:30.530131 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a2062-3668-447a-a575-d91be4fafd81 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:30.538601 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-447b13cf-b788-4d52-912f-6f595153647c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.239678 Oct 06 11:04:30.540089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 19/46] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:30 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:30.628055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7024596d-2869-4c7a-890c-a29099769576 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:30.628678 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7024596d-2869-4c7a-890c-a29099769576 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:30.640172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7024596d-2869-4c7a-890c-a29099769576 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:30.640172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7024596d-2869-4c7a-890c-a29099769576 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:30.640172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7024596d-2869-4c7a-890c-a29099769576 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:30.640172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7024596d-2869-4c7a-890c-a29099769576 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:30.651284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7024596d-2869-4c7a-890c-a29099769576 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:30.651941 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7024596d-2869-4c7a-890c-a29099769576 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:30.689840 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b77a2062-3668-447a-a575-d91be4fafd81 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:30.704588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b77a2062-3668-447a-a575-d91be4fafd81 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.190381 Oct 06 11:04:30.705172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 28/47] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:30 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:30.720886 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7024596d-2869-4c7a-890c-a29099769576 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:30.728399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7024596d-2869-4c7a-890c-a29099769576 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.104148 Oct 06 11:04:30.728964 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 20/48] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:30 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:31.155272 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:31.156087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:31.159601 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:31.163407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:31.165798 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:31.166378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:31.167098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:31.167552 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:31.168070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:31.256571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:31.267473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:31.269404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:31.270977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ce4aaf22-db6b-492a-87e6-d48de898d644 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.122671 Oct 06 11:04:31.271555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 29/49] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:31 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:31.564886 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0cdb012-298c-49c1-b17c-7f210b8b78be tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:31.566445 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0cdb012-298c-49c1-b17c-7f210b8b78be tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:31.577895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cdb012-298c-49c1-b17c-7f210b8b78be tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:31.578390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cdb012-298c-49c1-b17c-7f210b8b78be tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:31.580532 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cdb012-298c-49c1-b17c-7f210b8b78be tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:31.581480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cdb012-298c-49c1-b17c-7f210b8b78be tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:31.582146 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cdb012-298c-49c1-b17c-7f210b8b78be tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:31.583149 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cdb012-298c-49c1-b17c-7f210b8b78be tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:31.728768 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1a35c21-60b1-4f74-aef3-6584f68e5131 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:31.730012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1a35c21-60b1-4f74-aef3-6584f68e5131 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:31.740254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1a35c21-60b1-4f74-aef3-6584f68e5131 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:31.740757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1a35c21-60b1-4f74-aef3-6584f68e5131 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:31.741204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1a35c21-60b1-4f74-aef3-6584f68e5131 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:31.743652 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1a35c21-60b1-4f74-aef3-6584f68e5131 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:31.744328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1a35c21-60b1-4f74-aef3-6584f68e5131 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:31.745023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1a35c21-60b1-4f74-aef3-6584f68e5131 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:31.746408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0cdb012-298c-49c1-b17c-7f210b8b78be tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:31.756685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0cdb012-298c-49c1-b17c-7f210b8b78be tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.195907 Oct 06 11:04:31.757852 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 21/50] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:31 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:31.783579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b714c27f-7e4c-4d05-bf0b-a2502197d701 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:31.785493 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b714c27f-7e4c-4d05-bf0b-a2502197d701 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:31.797577 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b714c27f-7e4c-4d05-bf0b-a2502197d701 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:31.808486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b714c27f-7e4c-4d05-bf0b-a2502197d701 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:31.809401 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b714c27f-7e4c-4d05-bf0b-a2502197d701 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:31.810485 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b714c27f-7e4c-4d05-bf0b-a2502197d701 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:31.811675 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b714c27f-7e4c-4d05-bf0b-a2502197d701 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:31.812646 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b714c27f-7e4c-4d05-bf0b-a2502197d701 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:31.918661 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b714c27f-7e4c-4d05-bf0b-a2502197d701 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:31.929832 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b714c27f-7e4c-4d05-bf0b-a2502197d701 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.170596 Oct 06 11:04:31.943942 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 22/51] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:31 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:31.954238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1a35c21-60b1-4f74-aef3-6584f68e5131 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:31.962705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1a35c21-60b1-4f74-aef3-6584f68e5131 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.238254 Oct 06 11:04:31.963294 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 30/52] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:31 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:32.297484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:32.298111 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:32.304382 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:32.304876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:32.305317 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:32.306194 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:32.306655 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:32.307082 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:32.378174 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:32.394674 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:32.397117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:32.399007 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-238364b6-632f-4153-a62e-f5a3f5c320d7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.106428 Oct 06 11:04:32.402259 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 23/53] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:32 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:32.784959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ab18909-83cf-4479-95d6-810f200f3fea tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:32.785577 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6ab18909-83cf-4479-95d6-810f200f3fea tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:32.787386 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:32.793005 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab18909-83cf-4479-95d6-810f200f3fea tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:32.793493 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab18909-83cf-4479-95d6-810f200f3fea tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:32.793931 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab18909-83cf-4479-95d6-810f200f3fea tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:32.794656 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab18909-83cf-4479-95d6-810f200f3fea tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:32.795108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab18909-83cf-4479-95d6-810f200f3fea tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:32.796378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab18909-83cf-4479-95d6-810f200f3fea tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:32.930193 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ab18909-83cf-4479-95d6-810f200f3fea tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:32.938489 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ab18909-83cf-4479-95d6-810f200f3fea tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.157339 Oct 06 11:04:32.939060 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 31/54] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:32 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:32.953476 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53b9ad9d-b877-4f4c-9cae-4f349beac78c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:32.954111 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53b9ad9d-b877-4f4c-9cae-4f349beac78c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:32.960083 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53b9ad9d-b877-4f4c-9cae-4f349beac78c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:32.960577 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53b9ad9d-b877-4f4c-9cae-4f349beac78c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:32.961020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53b9ad9d-b877-4f4c-9cae-4f349beac78c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:32.961719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53b9ad9d-b877-4f4c-9cae-4f349beac78c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:32.962176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53b9ad9d-b877-4f4c-9cae-4f349beac78c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:32.962605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53b9ad9d-b877-4f4c-9cae-4f349beac78c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:32.987241 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51e7b554-ff1b-414b-a912-5d9d2b5fcba6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:32.988007 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-51e7b554-ff1b-414b-a912-5d9d2b5fcba6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:32.993866 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e7b554-ff1b-414b-a912-5d9d2b5fcba6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:32.994428 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e7b554-ff1b-414b-a912-5d9d2b5fcba6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:32.994942 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e7b554-ff1b-414b-a912-5d9d2b5fcba6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:32.995762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e7b554-ff1b-414b-a912-5d9d2b5fcba6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:32.996327 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e7b554-ff1b-414b-a912-5d9d2b5fcba6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:32.996830 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e7b554-ff1b-414b-a912-5d9d2b5fcba6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:33.016200 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:33.028252 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-53b9ad9d-b877-4f4c-9cae-4f349beac78c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:33.062088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53b9ad9d-b877-4f4c-9cae-4f349beac78c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.112299 Oct 06 11:04:33.064230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 24/55] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:32 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:33.144686 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-51e7b554-ff1b-414b-a912-5d9d2b5fcba6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:33.152409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-51e7b554-ff1b-414b-a912-5d9d2b5fcba6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.169267 Oct 06 11:04:33.152973 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 32/56] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:32 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:33.427024 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:33.427648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:33.433558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:33.434053 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:33.434497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:33.435184 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:33.435638 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:33.436642 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:33.500036 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:33.510198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:33.510575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:33.511784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b804bbb-b7fa-4873-a1ee-0ba4c71a04b6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.088943 Oct 06 11:04:33.527737 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 25/57] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:33 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:33.962488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-56d01fcb-dcc0-47ea-ada1-50fdcc37eeab tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:33.963041 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-56d01fcb-dcc0-47ea-ada1-50fdcc37eeab tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:33.969370 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d01fcb-dcc0-47ea-ada1-50fdcc37eeab tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:33.969911 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d01fcb-dcc0-47ea-ada1-50fdcc37eeab tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:33.970357 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d01fcb-dcc0-47ea-ada1-50fdcc37eeab tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:33.971065 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d01fcb-dcc0-47ea-ada1-50fdcc37eeab tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:33.971518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d01fcb-dcc0-47ea-ada1-50fdcc37eeab tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:33.971966 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d01fcb-dcc0-47ea-ada1-50fdcc37eeab tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:33.993663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=28 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:34.088770 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f18b6be6-d619-4715-a64c-5d719921e897 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:34.090701 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f18b6be6-d619-4715-a64c-5d719921e897 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:34.100372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f18b6be6-d619-4715-a64c-5d719921e897 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:34.101050 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f18b6be6-d619-4715-a64c-5d719921e897 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:34.101669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f18b6be6-d619-4715-a64c-5d719921e897 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:34.102376 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f18b6be6-d619-4715-a64c-5d719921e897 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:34.102827 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f18b6be6-d619-4715-a64c-5d719921e897 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:34.103250 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f18b6be6-d619-4715-a64c-5d719921e897 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:34.152684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-56d01fcb-dcc0-47ea-ada1-50fdcc37eeab tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:34.162637 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-56d01fcb-dcc0-47ea-ada1-50fdcc37eeab tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.203901 Oct 06 11:04:34.163830 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 33/58] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:33 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:34.177420 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-17971541-0bbb-44dc-9eb0-ba81af29402e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:34.178468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-17971541-0bbb-44dc-9eb0-ba81af29402e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:34.186853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f18b6be6-d619-4715-a64c-5d719921e897 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:34.189628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17971541-0bbb-44dc-9eb0-ba81af29402e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:34.190654 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17971541-0bbb-44dc-9eb0-ba81af29402e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:34.190940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17971541-0bbb-44dc-9eb0-ba81af29402e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:34.192268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17971541-0bbb-44dc-9eb0-ba81af29402e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:34.192732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17971541-0bbb-44dc-9eb0-ba81af29402e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:34.193206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17971541-0bbb-44dc-9eb0-ba81af29402e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:34.200347 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f18b6be6-d619-4715-a64c-5d719921e897 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.117053 Oct 06 11:04:34.201523 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 26/59] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:34 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:34.363017 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-17971541-0bbb-44dc-9eb0-ba81af29402e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:34.370584 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-17971541-0bbb-44dc-9eb0-ba81af29402e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.198203 Oct 06 11:04:34.371154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 34/60] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:34 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:34.540204 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:34.544244 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:34.547651 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:34.548169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:34.548690 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:34.549293 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:34.549746 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:34.550162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:34.642224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:34.651824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:34.653484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:34.656480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-564fca83-9ea3-4928-84c2-6cb062649b52 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.118686 Oct 06 11:04:34.657351 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 27/61] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:34 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:35.187131 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c9afa324-0e6a-4d49-b04d-b37104eaa656 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:35.187899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c9afa324-0e6a-4d49-b04d-b37104eaa656 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:35.195089 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9afa324-0e6a-4d49-b04d-b37104eaa656 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:35.195659 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9afa324-0e6a-4d49-b04d-b37104eaa656 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:35.196056 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9afa324-0e6a-4d49-b04d-b37104eaa656 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:35.196767 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9afa324-0e6a-4d49-b04d-b37104eaa656 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:35.197238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9afa324-0e6a-4d49-b04d-b37104eaa656 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:35.197635 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9afa324-0e6a-4d49-b04d-b37104eaa656 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:35.225393 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5026c07-f819-43ae-a1f4-b88837a4cba9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:35.226129 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5026c07-f819-43ae-a1f4-b88837a4cba9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:35.239199 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:35.241821 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5026c07-f819-43ae-a1f4-b88837a4cba9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:35.242508 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5026c07-f819-43ae-a1f4-b88837a4cba9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:35.243111 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5026c07-f819-43ae-a1f4-b88837a4cba9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:35.244244 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5026c07-f819-43ae-a1f4-b88837a4cba9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:35.245027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5026c07-f819-43ae-a1f4-b88837a4cba9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:35.248435 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5026c07-f819-43ae-a1f4-b88837a4cba9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:35.317068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5026c07-f819-43ae-a1f4-b88837a4cba9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:35.330231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5026c07-f819-43ae-a1f4-b88837a4cba9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.109346 Oct 06 11:04:35.330918 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 28/62] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:35 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:35.385041 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9afa324-0e6a-4d49-b04d-b37104eaa656 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:35.397117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2b5d951-d9c0-4715-9efd-e6d9166406cf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:35.398029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c9afa324-0e6a-4d49-b04d-b37104eaa656 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.214871 Oct 06 11:04:35.398144 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b2b5d951-d9c0-4715-9efd-e6d9166406cf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:35.398617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 35/63] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:35 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:35.413374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2b5d951-d9c0-4715-9efd-e6d9166406cf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:35.414184 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2b5d951-d9c0-4715-9efd-e6d9166406cf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:35.414842 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2b5d951-d9c0-4715-9efd-e6d9166406cf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:35.415801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2b5d951-d9c0-4715-9efd-e6d9166406cf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:35.416586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2b5d951-d9c0-4715-9efd-e6d9166406cf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:35.417413 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2b5d951-d9c0-4715-9efd-e6d9166406cf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:35.576080 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2b5d951-d9c0-4715-9efd-e6d9166406cf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:35.588265 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b2b5d951-d9c0-4715-9efd-e6d9166406cf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.196062 Oct 06 11:04:35.588938 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 29/64] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:35 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:35.681051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:35.681785 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:35.688322 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:35.688818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:35.689260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:35.689976 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:35.690432 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:35.690859 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:35.798123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:35.808836 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:35.810769 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:35.812354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f052fe2b-220f-40b8-b728-79888fc9b26d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.135195 Oct 06 11:04:35.813404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 36/65] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:35 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:36.353954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd511325-36c0-46bd-9f7b-7a174e9703e2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:36.360602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bd511325-36c0-46bd-9f7b-7a174e9703e2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:36.360602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=18 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:36.362705 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd511325-36c0-46bd-9f7b-7a174e9703e2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:36.363387 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd511325-36c0-46bd-9f7b-7a174e9703e2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:36.364020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd511325-36c0-46bd-9f7b-7a174e9703e2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:36.364886 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd511325-36c0-46bd-9f7b-7a174e9703e2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:36.365610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd511325-36c0-46bd-9f7b-7a174e9703e2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:36.366046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd511325-36c0-46bd-9f7b-7a174e9703e2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:36.425204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9580aa6-b140-4e7e-842b-ee356b159b61 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:36.425747 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b9580aa6-b140-4e7e-842b-ee356b159b61 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:36.432157 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9580aa6-b140-4e7e-842b-ee356b159b61 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:36.432670 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9580aa6-b140-4e7e-842b-ee356b159b61 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:36.433307 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9580aa6-b140-4e7e-842b-ee356b159b61 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:36.434072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9580aa6-b140-4e7e-842b-ee356b159b61 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:36.434566 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9580aa6-b140-4e7e-842b-ee356b159b61 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:36.435007 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9580aa6-b140-4e7e-842b-ee356b159b61 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:36.454756 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bd511325-36c0-46bd-9f7b-7a174e9703e2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:36.458224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:36.475706 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd511325-36c0-46bd-9f7b-7a174e9703e2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.125649 Oct 06 11:04:36.485700 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 30/66] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:36 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:36.614830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef71a82a-b6a9-46fb-bfc3-d37a0865bbc4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:36.615446 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef71a82a-b6a9-46fb-bfc3-d37a0865bbc4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:36.618368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:36.622074 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef71a82a-b6a9-46fb-bfc3-d37a0865bbc4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:36.622772 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef71a82a-b6a9-46fb-bfc3-d37a0865bbc4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:36.623211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef71a82a-b6a9-46fb-bfc3-d37a0865bbc4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:36.624098 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef71a82a-b6a9-46fb-bfc3-d37a0865bbc4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:36.624690 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef71a82a-b6a9-46fb-bfc3-d37a0865bbc4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:36.625968 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef71a82a-b6a9-46fb-bfc3-d37a0865bbc4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:36.652947 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9580aa6-b140-4e7e-842b-ee356b159b61 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:36.664213 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9580aa6-b140-4e7e-842b-ee356b159b61 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.243537 Oct 06 11:04:36.679108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 37/67] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:36 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:36.835694 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef71a82a-b6a9-46fb-bfc3-d37a0865bbc4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:36.851564 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef71a82a-b6a9-46fb-bfc3-d37a0865bbc4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.241865 Oct 06 11:04:36.852675 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 31/68] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:36 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:36.871274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:36.878436 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:36.899381 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:36.900821 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:36.910982 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:36.913889 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:36.926007 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:36.927344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:37.051640 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:37.064447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:37.066191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:37.067386 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c6ee394-d9d5-43a6-8fb8-f7f808a403e3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.231039 Oct 06 11:04:37.068697 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 38/69] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:36 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:37.498539 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f13a039c-8548-4e39-ac28-7cfc6449c8e0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:37.499157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f13a039c-8548-4e39-ac28-7cfc6449c8e0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:37.506897 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f13a039c-8548-4e39-ac28-7cfc6449c8e0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:37.507403 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f13a039c-8548-4e39-ac28-7cfc6449c8e0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:37.507862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f13a039c-8548-4e39-ac28-7cfc6449c8e0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:37.508605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f13a039c-8548-4e39-ac28-7cfc6449c8e0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:37.509053 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f13a039c-8548-4e39-ac28-7cfc6449c8e0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:37.509549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f13a039c-8548-4e39-ac28-7cfc6449c8e0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:37.574951 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f13a039c-8548-4e39-ac28-7cfc6449c8e0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:37.584409 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f13a039c-8548-4e39-ac28-7cfc6449c8e0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.089555 Oct 06 11:04:37.585610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 32/70] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:37 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:37.688389 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e864fd4-bb9f-41bd-976e-020ad15bc4d0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:37.689635 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e864fd4-bb9f-41bd-976e-020ad15bc4d0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:37.696998 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e864fd4-bb9f-41bd-976e-020ad15bc4d0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:37.697613 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e864fd4-bb9f-41bd-976e-020ad15bc4d0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:37.698166 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e864fd4-bb9f-41bd-976e-020ad15bc4d0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:37.698965 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e864fd4-bb9f-41bd-976e-020ad15bc4d0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:37.699426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e864fd4-bb9f-41bd-976e-020ad15bc4d0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:37.699871 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e864fd4-bb9f-41bd-976e-020ad15bc4d0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:37.845705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8e864fd4-bb9f-41bd-976e-020ad15bc4d0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:37.853749 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e864fd4-bb9f-41bd-976e-020ad15bc4d0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.169328 Oct 06 11:04:37.854326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 39/71] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:37 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:37.891634 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb1be238-d6b3-40d2-845b-7b91813b065a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:37.892426 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb1be238-d6b3-40d2-845b-7b91813b065a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:37.899010 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1be238-d6b3-40d2-845b-7b91813b065a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:37.899507 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1be238-d6b3-40d2-845b-7b91813b065a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:37.899976 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1be238-d6b3-40d2-845b-7b91813b065a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:37.900677 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1be238-d6b3-40d2-845b-7b91813b065a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:37.901126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1be238-d6b3-40d2-845b-7b91813b065a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:37.901544 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1be238-d6b3-40d2-845b-7b91813b065a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:38.084759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb1be238-d6b3-40d2-845b-7b91813b065a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:38.093457 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:38.095368 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:38.096924 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb1be238-d6b3-40d2-845b-7b91813b065a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.210054 Oct 06 11:04:38.098267 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 33/72] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:37 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:38.109197 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:38.110237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:38.110838 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:38.111705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:38.112368 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:38.112973 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:38.191657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:38.206075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:38.208573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:38.209679 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0546737f-f609-4131-b230-dfddcd2605a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.120142 Oct 06 11:04:38.210260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 40/73] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:38 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:38.607797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-da80c9d9-ceb6-44a5-8aa6-ba25a56179ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:38.608442 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-da80c9d9-ceb6-44a5-8aa6-ba25a56179ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:38.614394 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da80c9d9-ceb6-44a5-8aa6-ba25a56179ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:38.614884 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da80c9d9-ceb6-44a5-8aa6-ba25a56179ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:38.615326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da80c9d9-ceb6-44a5-8aa6-ba25a56179ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:38.616049 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da80c9d9-ceb6-44a5-8aa6-ba25a56179ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:38.616509 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da80c9d9-ceb6-44a5-8aa6-ba25a56179ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:38.616936 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da80c9d9-ceb6-44a5-8aa6-ba25a56179ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:38.677857 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-da80c9d9-ceb6-44a5-8aa6-ba25a56179ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:38.685400 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-da80c9d9-ceb6-44a5-8aa6-ba25a56179ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.081513 Oct 06 11:04:38.685959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 34/74] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:38 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:38.876976 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ae0da2d-c19d-47ad-b339-03246adad412 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:38.877656 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ae0da2d-c19d-47ad-b339-03246adad412 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:38.883727 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ae0da2d-c19d-47ad-b339-03246adad412 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:38.884247 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ae0da2d-c19d-47ad-b339-03246adad412 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:38.884689 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ae0da2d-c19d-47ad-b339-03246adad412 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:38.885379 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ae0da2d-c19d-47ad-b339-03246adad412 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:38.885836 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ae0da2d-c19d-47ad-b339-03246adad412 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:38.886262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ae0da2d-c19d-47ad-b339-03246adad412 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:39.014683 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ae0da2d-c19d-47ad-b339-03246adad412 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:39.023911 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ae0da2d-c19d-47ad-b339-03246adad412 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.151488 Oct 06 11:04:39.024801 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 41/75] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:38 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:39.122405 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f381fec9-e3a4-4395-ab06-5bcc587de02e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:39.123043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f381fec9-e3a4-4395-ab06-5bcc587de02e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:39.129577 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f381fec9-e3a4-4395-ab06-5bcc587de02e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:39.130025 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f381fec9-e3a4-4395-ab06-5bcc587de02e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:39.130458 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f381fec9-e3a4-4395-ab06-5bcc587de02e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:39.131135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f381fec9-e3a4-4395-ab06-5bcc587de02e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:39.131580 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f381fec9-e3a4-4395-ab06-5bcc587de02e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:39.132029 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f381fec9-e3a4-4395-ab06-5bcc587de02e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:39.235823 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:39.236750 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:39.242623 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:39.243178 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:39.243704 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:39.244510 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:39.245030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:39.245519 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:39.256474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f381fec9-e3a4-4395-ab06-5bcc587de02e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:39.264117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f381fec9-e3a4-4395-ab06-5bcc587de02e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.145523 Oct 06 11:04:39.264683 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 35/76] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:39 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:39.310249 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:39.318956 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:39.320439 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:39.321530 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f69bfde-c62c-4acf-8e50-b1a6ccb548fc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.089637 Oct 06 11:04:39.322084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 42/77] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:39 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:04:39.708108 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d34cd7d8-94bd-4472-857a-7f85ad35646c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:39.708652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d34cd7d8-94bd-4472-857a-7f85ad35646c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:39.715214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d34cd7d8-94bd-4472-857a-7f85ad35646c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:39.715981 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d34cd7d8-94bd-4472-857a-7f85ad35646c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:39.716592 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d34cd7d8-94bd-4472-857a-7f85ad35646c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:39.717463 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d34cd7d8-94bd-4472-857a-7f85ad35646c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:39.717920 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d34cd7d8-94bd-4472-857a-7f85ad35646c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:39.718360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d34cd7d8-94bd-4472-857a-7f85ad35646c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:39.785255 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d34cd7d8-94bd-4472-857a-7f85ad35646c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:39.793050 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d34cd7d8-94bd-4472-857a-7f85ad35646c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.089029 Oct 06 11:04:39.793862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 36/78] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:39 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:40.046543 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7793bad-291a-4a2c-acdd-b1dcc913a4f1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:40.048211 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a7793bad-291a-4a2c-acdd-b1dcc913a4f1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:40.054427 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7793bad-291a-4a2c-acdd-b1dcc913a4f1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:40.065290 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7793bad-291a-4a2c-acdd-b1dcc913a4f1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:40.066832 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7793bad-291a-4a2c-acdd-b1dcc913a4f1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:40.068196 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7793bad-291a-4a2c-acdd-b1dcc913a4f1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:40.068835 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7793bad-291a-4a2c-acdd-b1dcc913a4f1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:40.069432 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7793bad-291a-4a2c-acdd-b1dcc913a4f1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:40.225776 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7793bad-291a-4a2c-acdd-b1dcc913a4f1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:40.234123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a7793bad-291a-4a2c-acdd-b1dcc913a4f1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.191298 Oct 06 11:04:40.235384 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 43/79] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:40 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:40.287873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-766a37c2-659d-4ae8-b5e2-b9f53cc442e9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:40.288486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-766a37c2-659d-4ae8-b5e2-b9f53cc442e9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:40.294361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766a37c2-659d-4ae8-b5e2-b9f53cc442e9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:40.294848 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766a37c2-659d-4ae8-b5e2-b9f53cc442e9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:40.295280 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766a37c2-659d-4ae8-b5e2-b9f53cc442e9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:40.296003 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766a37c2-659d-4ae8-b5e2-b9f53cc442e9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:40.296454 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766a37c2-659d-4ae8-b5e2-b9f53cc442e9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:40.297537 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766a37c2-659d-4ae8-b5e2-b9f53cc442e9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:40.346261 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:40.347058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:40.353283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:40.353776 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:40.354208 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:40.354909 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:40.355356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:40.355778 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:40.426210 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:40.434389 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:40.435831 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:40.436959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10ce548d-c331-4141-a8a6-b0df68b51cfa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.094680 Oct 06 11:04:40.437615 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 44/80] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:40 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:04:40.439034 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-766a37c2-659d-4ae8-b5e2-b9f53cc442e9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:40.447517 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-766a37c2-659d-4ae8-b5e2-b9f53cc442e9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.163482 Oct 06 11:04:40.448517 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 37/81] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:40 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:40.816793 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7d28fc81-c62a-467d-8c35-33b8ef752dac tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:40.817398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7d28fc81-c62a-467d-8c35-33b8ef752dac tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:40.823446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d28fc81-c62a-467d-8c35-33b8ef752dac tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:40.823962 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d28fc81-c62a-467d-8c35-33b8ef752dac tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:40.824397 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d28fc81-c62a-467d-8c35-33b8ef752dac tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:40.825088 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d28fc81-c62a-467d-8c35-33b8ef752dac tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:40.825532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d28fc81-c62a-467d-8c35-33b8ef752dac tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:40.825957 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d28fc81-c62a-467d-8c35-33b8ef752dac tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:40.888142 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d28fc81-c62a-467d-8c35-33b8ef752dac tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:40.900125 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7d28fc81-c62a-467d-8c35-33b8ef752dac tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.087030 Oct 06 11:04:40.900856 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 45/82] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:40 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:41.258487 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9add9425-92b3-4041-938d-02242134da98 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:41.259477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9add9425-92b3-4041-938d-02242134da98 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:41.266416 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9add9425-92b3-4041-938d-02242134da98 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:41.266899 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9add9425-92b3-4041-938d-02242134da98 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:41.267332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9add9425-92b3-4041-938d-02242134da98 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:41.268059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9add9425-92b3-4041-938d-02242134da98 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:41.268507 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9add9425-92b3-4041-938d-02242134da98 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:41.268928 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9add9425-92b3-4041-938d-02242134da98 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:41.415414 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9add9425-92b3-4041-938d-02242134da98 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:41.429407 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9add9425-92b3-4041-938d-02242134da98 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.174291 Oct 06 11:04:41.430145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 38/83] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:41 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:41.462009 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:41.462618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:41.470101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eff8aecc-8741-49f9-b113-475247984015 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:41.470559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:41.470663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:41.470994 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eff8aecc-8741-49f9-b113-475247984015 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:41.471102 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:41.471743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:41.472249 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:41.472705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:41.477681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff8aecc-8741-49f9-b113-475247984015 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:41.478299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff8aecc-8741-49f9-b113-475247984015 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:41.478978 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff8aecc-8741-49f9-b113-475247984015 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:41.479783 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff8aecc-8741-49f9-b113-475247984015 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:41.480322 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff8aecc-8741-49f9-b113-475247984015 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:41.480830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff8aecc-8741-49f9-b113-475247984015 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:41.574330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:41.586605 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:41.589484 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:41.591199 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c3d16b3-004d-4f4f-9cdb-b2c84b1a5049 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.132935 Oct 06 11:04:41.591962 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 46/84] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:41 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:41.654483 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eff8aecc-8741-49f9-b113-475247984015 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:41.663849 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eff8aecc-8741-49f9-b113-475247984015 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.198235 Oct 06 11:04:41.664548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 39/85] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:41 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:41.923535 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a044827-8708-453c-8236-23af5a1d8500 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:41.924092 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a044827-8708-453c-8236-23af5a1d8500 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:41.929899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a044827-8708-453c-8236-23af5a1d8500 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:41.930383 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a044827-8708-453c-8236-23af5a1d8500 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:41.930815 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a044827-8708-453c-8236-23af5a1d8500 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:41.931509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a044827-8708-453c-8236-23af5a1d8500 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:41.931988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a044827-8708-453c-8236-23af5a1d8500 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:41.932414 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a044827-8708-453c-8236-23af5a1d8500 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:41.993057 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a044827-8708-453c-8236-23af5a1d8500 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:42.001145 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a044827-8708-453c-8236-23af5a1d8500 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.082087 Oct 06 11:04:42.001724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 47/86] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:41 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:42.454544 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb3f1aa1-51e9-4389-8366-b12dae2634a0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:42.455161 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb3f1aa1-51e9-4389-8366-b12dae2634a0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:42.461209 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3f1aa1-51e9-4389-8366-b12dae2634a0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:42.461639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3f1aa1-51e9-4389-8366-b12dae2634a0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:42.462078 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3f1aa1-51e9-4389-8366-b12dae2634a0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:42.462759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3f1aa1-51e9-4389-8366-b12dae2634a0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:42.463211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3f1aa1-51e9-4389-8366-b12dae2634a0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:42.463633 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb3f1aa1-51e9-4389-8366-b12dae2634a0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:42.589101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb3f1aa1-51e9-4389-8366-b12dae2634a0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:42.598022 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb3f1aa1-51e9-4389-8366-b12dae2634a0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.148535 Oct 06 11:04:42.598583 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 40/87] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:42 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:42.616295 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:42.616905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:42.622803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:42.623289 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:42.623730 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:42.624441 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:42.624898 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:42.625969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:42.686718 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34e94292-1302-448e-a727-52affb7ce092 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:42.687403 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-34e94292-1302-448e-a727-52affb7ce092 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:42.688192 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:42.693711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34e94292-1302-448e-a727-52affb7ce092 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:42.694205 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34e94292-1302-448e-a727-52affb7ce092 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:42.694648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34e94292-1302-448e-a727-52affb7ce092 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:42.695342 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34e94292-1302-448e-a727-52affb7ce092 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:42.695796 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34e94292-1302-448e-a727-52affb7ce092 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:42.696256 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34e94292-1302-448e-a727-52affb7ce092 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:42.696468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:42.697934 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:42.699014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dcb3ab20-9217-4e1e-8697-5c4ceceef5c3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.086519 Oct 06 11:04:42.699559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 48/88] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:42 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:42.830756 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-34e94292-1302-448e-a727-52affb7ce092 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:42.839652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-34e94292-1302-448e-a727-52affb7ce092 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.156012 Oct 06 11:04:42.839652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 41/89] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:42 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:43.023351 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ccead37d-04c0-4b22-8bac-2a2dc0d6b69f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:43.023955 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ccead37d-04c0-4b22-8bac-2a2dc0d6b69f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:43.030216 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccead37d-04c0-4b22-8bac-2a2dc0d6b69f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:43.030707 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccead37d-04c0-4b22-8bac-2a2dc0d6b69f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:43.031172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccead37d-04c0-4b22-8bac-2a2dc0d6b69f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:43.032366 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccead37d-04c0-4b22-8bac-2a2dc0d6b69f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:43.032741 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccead37d-04c0-4b22-8bac-2a2dc0d6b69f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:43.033173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccead37d-04c0-4b22-8bac-2a2dc0d6b69f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:43.037464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:43.099484 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ccead37d-04c0-4b22-8bac-2a2dc0d6b69f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:43.108531 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ccead37d-04c0-4b22-8bac-2a2dc0d6b69f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.089357 Oct 06 11:04:43.109147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 49/90] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:43 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:43.621323 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c31b5151-5bbb-4db3-acc4-9ed3c404da56 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:43.621940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c31b5151-5bbb-4db3-acc4-9ed3c404da56 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:43.627860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c31b5151-5bbb-4db3-acc4-9ed3c404da56 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:43.628362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c31b5151-5bbb-4db3-acc4-9ed3c404da56 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:43.628799 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c31b5151-5bbb-4db3-acc4-9ed3c404da56 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:43.629482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c31b5151-5bbb-4db3-acc4-9ed3c404da56 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:43.629961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c31b5151-5bbb-4db3-acc4-9ed3c404da56 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:43.630356 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c31b5151-5bbb-4db3-acc4-9ed3c404da56 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:43.724617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:43.725630 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:43.732629 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:43.733124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:43.733562 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:43.734361 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:43.735547 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:43.736147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:43.761913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c31b5151-5bbb-4db3-acc4-9ed3c404da56 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:43.770697 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c31b5151-5bbb-4db3-acc4-9ed3c404da56 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.153179 Oct 06 11:04:43.771267 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 42/91] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:43 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:43.800562 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:43.808523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:43.809969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:43.811060 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e900ddb7-b8c0-4a00-8fa2-aa8ee029add4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.090498 Oct 06 11:04:43.811621 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 50/92] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:43 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:04:43.861904 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-073fe44d-2ea1-4d86-aa0f-a3f6235bff87 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:43.862517 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-073fe44d-2ea1-4d86-aa0f-a3f6235bff87 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:43.868361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073fe44d-2ea1-4d86-aa0f-a3f6235bff87 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:43.868842 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073fe44d-2ea1-4d86-aa0f-a3f6235bff87 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:43.869273 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073fe44d-2ea1-4d86-aa0f-a3f6235bff87 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:43.869957 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073fe44d-2ea1-4d86-aa0f-a3f6235bff87 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:43.870410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073fe44d-2ea1-4d86-aa0f-a3f6235bff87 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:43.870830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073fe44d-2ea1-4d86-aa0f-a3f6235bff87 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:43.998720 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-073fe44d-2ea1-4d86-aa0f-a3f6235bff87 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:44.006433 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-073fe44d-2ea1-4d86-aa0f-a3f6235bff87 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.148670 Oct 06 11:04:44.006995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 43/93] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:43 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:44.132307 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57309a91-bef7-4587-8236-b1a955ac2698 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:44.132852 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57309a91-bef7-4587-8236-b1a955ac2698 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:44.138909 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57309a91-bef7-4587-8236-b1a955ac2698 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:44.139399 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57309a91-bef7-4587-8236-b1a955ac2698 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:44.139853 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57309a91-bef7-4587-8236-b1a955ac2698 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:44.140674 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57309a91-bef7-4587-8236-b1a955ac2698 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:44.141625 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57309a91-bef7-4587-8236-b1a955ac2698 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:44.142055 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57309a91-bef7-4587-8236-b1a955ac2698 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:44.202292 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-57309a91-bef7-4587-8236-b1a955ac2698 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:44.210771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57309a91-bef7-4587-8236-b1a955ac2698 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.082493 Oct 06 11:04:44.211368 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 51/94] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:44 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:44.794370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19d73b46-5b68-4fbc-8ae3-15c1e47bf76d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:44.794981 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-19d73b46-5b68-4fbc-8ae3-15c1e47bf76d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:44.802127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19d73b46-5b68-4fbc-8ae3-15c1e47bf76d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:44.802834 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19d73b46-5b68-4fbc-8ae3-15c1e47bf76d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:44.803672 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19d73b46-5b68-4fbc-8ae3-15c1e47bf76d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:44.804956 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19d73b46-5b68-4fbc-8ae3-15c1e47bf76d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:44.805830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19d73b46-5b68-4fbc-8ae3-15c1e47bf76d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:44.806342 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19d73b46-5b68-4fbc-8ae3-15c1e47bf76d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:44.835988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:44.837352 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:44.846092 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:44.846929 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:44.847583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:44.849081 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:44.849665 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:44.850373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:44.915909 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:44.936363 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:44.937766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:44.939057 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bbdb4a9d-10db-4536-b2ea-06f8461c75ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.107416 Oct 06 11:04:44.940017 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 52/95] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:44 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:04:44.986902 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-19d73b46-5b68-4fbc-8ae3-15c1e47bf76d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:44.994605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19d73b46-5b68-4fbc-8ae3-15c1e47bf76d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.203973 Oct 06 11:04:44.995266 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 44/96] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:44 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:45.030561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7dbefeb2-6065-4973-9381-fa77a1f8417a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:45.031785 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7dbefeb2-6065-4973-9381-fa77a1f8417a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:45.038234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7dbefeb2-6065-4973-9381-fa77a1f8417a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:45.038732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7dbefeb2-6065-4973-9381-fa77a1f8417a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:45.039172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7dbefeb2-6065-4973-9381-fa77a1f8417a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:45.039972 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7dbefeb2-6065-4973-9381-fa77a1f8417a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:45.040432 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7dbefeb2-6065-4973-9381-fa77a1f8417a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:45.040859 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7dbefeb2-6065-4973-9381-fa77a1f8417a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:45.186586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7dbefeb2-6065-4973-9381-fa77a1f8417a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:45.194268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7dbefeb2-6065-4973-9381-fa77a1f8417a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.167662 Oct 06 11:04:45.194830 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 53/97] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:45 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:45.235471 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd102670-dbe4-4ea3-a129-0368768b110d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:45.236664 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bd102670-dbe4-4ea3-a129-0368768b110d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:45.245494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd102670-dbe4-4ea3-a129-0368768b110d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:45.246185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd102670-dbe4-4ea3-a129-0368768b110d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:45.246833 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd102670-dbe4-4ea3-a129-0368768b110d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:45.247756 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd102670-dbe4-4ea3-a129-0368768b110d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:45.248654 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd102670-dbe4-4ea3-a129-0368768b110d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:45.249579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd102670-dbe4-4ea3-a129-0368768b110d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:45.319065 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bd102670-dbe4-4ea3-a129-0368768b110d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:45.326738 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd102670-dbe4-4ea3-a129-0368768b110d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.096867 Oct 06 11:04:45.327377 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 45/98] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:45 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:45.964959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:45.965567 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:45.972084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:45.972571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:45.973000 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:45.973685 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:45.974131 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:45.974550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:46.018858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-434c405a-f06d-4316-a047-5f93c96565dd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:46.019525 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-434c405a-f06d-4316-a047-5f93c96565dd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:46.026038 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434c405a-f06d-4316-a047-5f93c96565dd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:46.026768 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434c405a-f06d-4316-a047-5f93c96565dd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:46.027200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434c405a-f06d-4316-a047-5f93c96565dd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:46.027912 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434c405a-f06d-4316-a047-5f93c96565dd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:46.028365 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434c405a-f06d-4316-a047-5f93c96565dd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:46.028780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434c405a-f06d-4316-a047-5f93c96565dd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:46.050830 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:46.059528 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:46.061237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:46.062407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5003a92b-4a4f-4003-801c-64612576c9ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.101208 Oct 06 11:04:46.063446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 54/99] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:45 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:46.184075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-434c405a-f06d-4316-a047-5f93c96565dd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:46.191724 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-434c405a-f06d-4316-a047-5f93c96565dd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.177256 Oct 06 11:04:46.192344 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 46/100] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:46 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:46.218141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93b147d3-180b-4f21-8681-4fddbee52b30 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:46.219564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-93b147d3-180b-4f21-8681-4fddbee52b30 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:46.225796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b147d3-180b-4f21-8681-4fddbee52b30 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:46.226280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b147d3-180b-4f21-8681-4fddbee52b30 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:46.226713 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b147d3-180b-4f21-8681-4fddbee52b30 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:46.227464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b147d3-180b-4f21-8681-4fddbee52b30 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:46.227876 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b147d3-180b-4f21-8681-4fddbee52b30 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:46.228305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b147d3-180b-4f21-8681-4fddbee52b30 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:46.350046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b41e46d-7d4e-466f-9b5c-2d4f7eeea4cf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:46.350814 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b41e46d-7d4e-466f-9b5c-2d4f7eeea4cf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:46.357669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b41e46d-7d4e-466f-9b5c-2d4f7eeea4cf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:46.358823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b41e46d-7d4e-466f-9b5c-2d4f7eeea4cf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:46.359455 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b41e46d-7d4e-466f-9b5c-2d4f7eeea4cf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:46.360471 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b41e46d-7d4e-466f-9b5c-2d4f7eeea4cf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:46.361062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b41e46d-7d4e-466f-9b5c-2d4f7eeea4cf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:46.361648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b41e46d-7d4e-466f-9b5c-2d4f7eeea4cf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:46.385732 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:46.389958 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-93b147d3-180b-4f21-8681-4fddbee52b30 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:46.400583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-93b147d3-180b-4f21-8681-4fddbee52b30 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.186731 Oct 06 11:04:46.401714 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 55/101] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:46 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:46.447708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b41e46d-7d4e-466f-9b5c-2d4f7eeea4cf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:46.456164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b41e46d-7d4e-466f-9b5c-2d4f7eeea4cf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.109984 Oct 06 11:04:46.456902 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 47/102] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:46 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:47.088349 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:47.088959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:47.095409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:47.095912 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:47.096342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:47.097022 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:47.097465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:47.097881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:47.171208 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:47.180181 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:47.181615 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:47.182822 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-52ca1f0a-180a-4cb1-83ba-7dd29a1e71d6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.098344 Oct 06 11:04:47.183633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 56/103] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:47 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:47.215456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68ec267e-545f-408f-b329-0fe9113d5d5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:47.216097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-68ec267e-545f-408f-b329-0fe9113d5d5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:47.222712 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ec267e-545f-408f-b329-0fe9113d5d5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:47.223333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ec267e-545f-408f-b329-0fe9113d5d5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:47.223777 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ec267e-545f-408f-b329-0fe9113d5d5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:47.224497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ec267e-545f-408f-b329-0fe9113d5d5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:47.224949 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ec267e-545f-408f-b329-0fe9113d5d5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:47.225394 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ec267e-545f-408f-b329-0fe9113d5d5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:47.371392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-68ec267e-545f-408f-b329-0fe9113d5d5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:47.380690 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68ec267e-545f-408f-b329-0fe9113d5d5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.168833 Oct 06 11:04:47.381528 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 48/104] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:47 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:47.428557 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bb82db40-a5db-468f-8fa5-331a2b1a35c2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:47.429345 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bb82db40-a5db-468f-8fa5-331a2b1a35c2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:47.435684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb82db40-a5db-468f-8fa5-331a2b1a35c2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:47.436633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb82db40-a5db-468f-8fa5-331a2b1a35c2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:47.437188 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb82db40-a5db-468f-8fa5-331a2b1a35c2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:47.438468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb82db40-a5db-468f-8fa5-331a2b1a35c2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:47.439098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb82db40-a5db-468f-8fa5-331a2b1a35c2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:47.439534 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb82db40-a5db-468f-8fa5-331a2b1a35c2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:47.479887 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72c08a22-63f0-44db-8006-308e59827b1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:47.481342 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-72c08a22-63f0-44db-8006-308e59827b1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:47.489332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72c08a22-63f0-44db-8006-308e59827b1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:47.490185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72c08a22-63f0-44db-8006-308e59827b1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:47.490824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72c08a22-63f0-44db-8006-308e59827b1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:47.491874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72c08a22-63f0-44db-8006-308e59827b1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:47.492525 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72c08a22-63f0-44db-8006-308e59827b1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:47.493164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72c08a22-63f0-44db-8006-308e59827b1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:47.564726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-72c08a22-63f0-44db-8006-308e59827b1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:47.572424 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72c08a22-63f0-44db-8006-308e59827b1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1279 microversion: 2.1 time: 0.097513 Oct 06 11:04:47.572997 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 49/105] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:47 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1279 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:47.645268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bb82db40-a5db-468f-8fa5-331a2b1a35c2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:47.653107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bb82db40-a5db-468f-8fa5-331a2b1a35c2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.231781 Oct 06 11:04:47.653678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 57/106] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:47 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:48.208850 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:48.209483 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:48.215766 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:48.216386 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:48.216932 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:48.218105 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:48.219338 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:48.219997 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:48.287533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:48.295723 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:48.297408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:48.298616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cae44195-8577-4a48-9ae3-5a3332566afd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1333 microversion: 2.20 time: 0.093683 Oct 06 11:04:48.299257 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 50/107] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:48 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:48.407753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38e20dbc-6f03-44cd-8461-a8f0fd5a25c3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:48.409012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-38e20dbc-6f03-44cd-8461-a8f0fd5a25c3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:48.417290 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38e20dbc-6f03-44cd-8461-a8f0fd5a25c3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:48.417780 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38e20dbc-6f03-44cd-8461-a8f0fd5a25c3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:48.418276 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38e20dbc-6f03-44cd-8461-a8f0fd5a25c3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:48.419551 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38e20dbc-6f03-44cd-8461-a8f0fd5a25c3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:48.420454 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38e20dbc-6f03-44cd-8461-a8f0fd5a25c3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:48.420545 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38e20dbc-6f03-44cd-8461-a8f0fd5a25c3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:48.598076 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-594ba21b-2a3d-4da4-8d5f-53e9d37dcbb7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:48.598706 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-594ba21b-2a3d-4da4-8d5f-53e9d37dcbb7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:48.609346 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-594ba21b-2a3d-4da4-8d5f-53e9d37dcbb7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:48.610026 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-594ba21b-2a3d-4da4-8d5f-53e9d37dcbb7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:48.610623 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-594ba21b-2a3d-4da4-8d5f-53e9d37dcbb7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:48.611492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-594ba21b-2a3d-4da4-8d5f-53e9d37dcbb7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:48.612338 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-594ba21b-2a3d-4da4-8d5f-53e9d37dcbb7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:48.612923 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-594ba21b-2a3d-4da4-8d5f-53e9d37dcbb7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:48.701751 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-38e20dbc-6f03-44cd-8461-a8f0fd5a25c3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:48.714094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38e20dbc-6f03-44cd-8461-a8f0fd5a25c3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.309952 Oct 06 11:04:48.714629 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 58/108] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:48 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:48.724206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9a08690-7592-43d4-8d11-ed2d8ffbe2d7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:48.725069 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e9a08690-7592-43d4-8d11-ed2d8ffbe2d7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:48.739557 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9a08690-7592-43d4-8d11-ed2d8ffbe2d7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:48.740878 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9a08690-7592-43d4-8d11-ed2d8ffbe2d7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:48.742743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9a08690-7592-43d4-8d11-ed2d8ffbe2d7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:48.743633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9a08690-7592-43d4-8d11-ed2d8ffbe2d7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:48.746662 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9a08690-7592-43d4-8d11-ed2d8ffbe2d7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:48.747273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9a08690-7592-43d4-8d11-ed2d8ffbe2d7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:49.026068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-594ba21b-2a3d-4da4-8d5f-53e9d37dcbb7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:49.035950 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-594ba21b-2a3d-4da4-8d5f-53e9d37dcbb7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.443702 Oct 06 11:04:49.036950 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 51/109] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:48 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:49.294360 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e9a08690-7592-43d4-8d11-ed2d8ffbe2d7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:49.309678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e9a08690-7592-43d4-8d11-ed2d8ffbe2d7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.593218 Oct 06 11:04:49.311188 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 59/110] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:48 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:49.325089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:49.325696 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:49.337237 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:49.340369 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:49.341533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:49.342870 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:49.343509 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:49.344963 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:49.715072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:49.730469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:49.732284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:49.733717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ff47dc4-160d-4ede-bcaa-a3d0de50c7d2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1341 microversion: 2.20 time: 0.413425 Oct 06 11:04:49.739642 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 52/111] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:49 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1341 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:49.759949 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-09619e1f-646e-4efe-a4bb-658d76b64097 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:49.760714 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-09619e1f-646e-4efe-a4bb-658d76b64097 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:49.770672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09619e1f-646e-4efe-a4bb-658d76b64097 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:49.772618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09619e1f-646e-4efe-a4bb-658d76b64097 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:49.773300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09619e1f-646e-4efe-a4bb-658d76b64097 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:49.775137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09619e1f-646e-4efe-a4bb-658d76b64097 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:49.777016 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09619e1f-646e-4efe-a4bb-658d76b64097 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:49.777457 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09619e1f-646e-4efe-a4bb-658d76b64097 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:50.068366 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-787af14b-67f9-4503-8e64-e50d7adee5ea tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:50.069259 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-787af14b-67f9-4503-8e64-e50d7adee5ea tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:50.086647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-787af14b-67f9-4503-8e64-e50d7adee5ea tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:50.087370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-787af14b-67f9-4503-8e64-e50d7adee5ea tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:50.087683 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-787af14b-67f9-4503-8e64-e50d7adee5ea tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:50.088431 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-787af14b-67f9-4503-8e64-e50d7adee5ea tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:50.088994 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-787af14b-67f9-4503-8e64-e50d7adee5ea tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:50.089474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-787af14b-67f9-4503-8e64-e50d7adee5ea tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:50.150648 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-09619e1f-646e-4efe-a4bb-658d76b64097 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:50.161417 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-09619e1f-646e-4efe-a4bb-658d76b64097 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.423833 Oct 06 11:04:50.161994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 60/112] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:49 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:50.338494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-45a4a3f5-01b5-4ae1-9f17-30d724c8baf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:50.339106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-45a4a3f5-01b5-4ae1-9f17-30d724c8baf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:50.347565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45a4a3f5-01b5-4ae1-9f17-30d724c8baf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:50.348917 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45a4a3f5-01b5-4ae1-9f17-30d724c8baf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:50.349593 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45a4a3f5-01b5-4ae1-9f17-30d724c8baf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:50.350700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45a4a3f5-01b5-4ae1-9f17-30d724c8baf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:50.351162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45a4a3f5-01b5-4ae1-9f17-30d724c8baf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:50.352389 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45a4a3f5-01b5-4ae1-9f17-30d724c8baf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:50.631781 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-45a4a3f5-01b5-4ae1-9f17-30d724c8baf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:50.640985 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-45a4a3f5-01b5-4ae1-9f17-30d724c8baf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.305890 Oct 06 11:04:50.642014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 61/113] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:50 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:50.766610 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:50.767289 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:50.774702 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:50.775120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:50.775774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:50.777765 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:50.778317 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:50.778937 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:50.860942 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-787af14b-67f9-4503-8e64-e50d7adee5ea tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:50.871409 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-787af14b-67f9-4503-8e64-e50d7adee5ea tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.812574 Oct 06 11:04:50.872156 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 53/114] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:50 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:50.982840 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:50.999520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:51.002919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:51.004427 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f54d73d-bfec-454a-ba0b-9100f0276c7f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1339 microversion: 2.20 time: 0.242539 Oct 06 11:04:51.030728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 62/115] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:50 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1339 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:51.194470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e65ebf3f-21a7-4513-87b2-8f38b5dd9a57 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:51.195604 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e65ebf3f-21a7-4513-87b2-8f38b5dd9a57 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:51.211762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65ebf3f-21a7-4513-87b2-8f38b5dd9a57 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:51.214356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65ebf3f-21a7-4513-87b2-8f38b5dd9a57 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:51.214954 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65ebf3f-21a7-4513-87b2-8f38b5dd9a57 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:51.218104 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65ebf3f-21a7-4513-87b2-8f38b5dd9a57 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:51.220328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65ebf3f-21a7-4513-87b2-8f38b5dd9a57 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:51.221671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65ebf3f-21a7-4513-87b2-8f38b5dd9a57 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:51.345644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d501aaa3-477b-44cc-809e-79373b620a2d req-d78dedcc-d009-4a71-8588-50b65b2dbf9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb86039-b159-435a-b022-4396a59b657c", "tag": "f595a1a4-6f82-46d6-9c95-1fd836a18532"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:51.361029 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d501aaa3-477b-44cc-809e-79373b620a2d req-d78dedcc-d009-4a71-8588-50b65b2dbf9a service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:51.361737 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d501aaa3-477b-44cc-809e-79373b620a2d req-d78dedcc-d009-4a71-8588-50b65b2dbf9a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:51.362565 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d501aaa3-477b-44cc-809e-79373b620a2d req-d78dedcc-d009-4a71-8588-50b65b2dbf9a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:51.393107 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d501aaa3-477b-44cc-809e-79373b620a2d req-d78dedcc-d009-4a71-8588-50b65b2dbf9a service nova] Creating event network-changed:f595a1a4-6f82-46d6-9c95-1fd836a18532 for instance 3eb86039-b159-435a-b022-4396a59b657c on hv-cinder-86020 Oct 06 11:04:51.393973 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d501aaa3-477b-44cc-809e-79373b620a2d req-d78dedcc-d009-4a71-8588-50b65b2dbf9a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 11:04:51.394784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d501aaa3-477b-44cc-809e-79373b620a2d req-d78dedcc-d009-4a71-8588-50b65b2dbf9a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 11:04:51.397251 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a43b6a7-2d7d-4f5f-ad11-44c5b8c3594c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:51.398476 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a43b6a7-2d7d-4f5f-ad11-44c5b8c3594c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:51.399035 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a43b6a7-2d7d-4f5f-ad11-44c5b8c3594c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:51.400531 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a43b6a7-2d7d-4f5f-ad11-44c5b8c3594c None None] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:51.401407 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a43b6a7-2d7d-4f5f-ad11-44c5b8c3594c None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:51.402023 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a43b6a7-2d7d-4f5f-ad11-44c5b8c3594c None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:51.424357 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.compute.rpcapi [None req-9a43b6a7-2d7d-4f5f-ad11-44c5b8c3594c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 06 11:04:51.425464 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a43b6a7-2d7d-4f5f-ad11-44c5b8c3594c None None] Releasing lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 11:04:51.446353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9a43b6a7-2d7d-4f5f-ad11-44c5b8c3594c None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286539 Oct 06 11:04:51.447132 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 54/116] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:51.523768 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e65ebf3f-21a7-4513-87b2-8f38b5dd9a57 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:51.533049 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e65ebf3f-21a7-4513-87b2-8f38b5dd9a57 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.346174 Oct 06 11:04:51.534371 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 63/117] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:51 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:51.676396 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2164203-8153-4eec-bc56-e683df26499f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:51.676396 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2164203-8153-4eec-bc56-e683df26499f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:51.676396 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2164203-8153-4eec-bc56-e683df26499f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:51.676396 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2164203-8153-4eec-bc56-e683df26499f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:51.676818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2164203-8153-4eec-bc56-e683df26499f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:51.676818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2164203-8153-4eec-bc56-e683df26499f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:51.676818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2164203-8153-4eec-bc56-e683df26499f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:51.676818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2164203-8153-4eec-bc56-e683df26499f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:51.895168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c8f080eb-e14d-4332-bfd3-62ad5b430c83 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:51.896965 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c8f080eb-e14d-4332-bfd3-62ad5b430c83 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:51.909989 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f080eb-e14d-4332-bfd3-62ad5b430c83 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:51.912066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f080eb-e14d-4332-bfd3-62ad5b430c83 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:51.915071 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f080eb-e14d-4332-bfd3-62ad5b430c83 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:51.916199 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f080eb-e14d-4332-bfd3-62ad5b430c83 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:51.916823 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f080eb-e14d-4332-bfd3-62ad5b430c83 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:51.917596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f080eb-e14d-4332-bfd3-62ad5b430c83 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:52.268227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e2164203-8153-4eec-bc56-e683df26499f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:52.278844 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2164203-8153-4eec-bc56-e683df26499f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.616359 Oct 06 11:04:52.278844 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 55/118] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:51 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:52.286219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:52.287040 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:52.310421 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c8f080eb-e14d-4332-bfd3-62ad5b430c83 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:52.317877 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:52.319646 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:52.321436 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c8f080eb-e14d-4332-bfd3-62ad5b430c83 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.430705 Oct 06 11:04:52.322507 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 64/119] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:51 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:52.322797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:52.323678 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:52.326319 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:52.326993 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:52.450700 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:52.467664 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:52.471147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:52.472970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67bb5316-8a8b-4049-ae15-0e9a85b6f83c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1339 microversion: 2.20 time: 0.190519 Oct 06 11:04:52.474010 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 56/120] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:52 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1339 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:52.556948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9220ddbb-88f8-4889-ad33-d47c26361704 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:52.557573 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9220ddbb-88f8-4889-ad33-d47c26361704 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:52.564475 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9220ddbb-88f8-4889-ad33-d47c26361704 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:52.565162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9220ddbb-88f8-4889-ad33-d47c26361704 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:52.565754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9220ddbb-88f8-4889-ad33-d47c26361704 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:52.566627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9220ddbb-88f8-4889-ad33-d47c26361704 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:52.567406 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9220ddbb-88f8-4889-ad33-d47c26361704 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:52.568041 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9220ddbb-88f8-4889-ad33-d47c26361704 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:52.588222 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-5a0b4f0f-664e-4137-96cf-9d1ea768d19e req-f6cd6699-86f3-4fc7-a9bf-f708e292ddaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41685b83-a75b-4abc-814c-c9a4424f2c65", "tag": "5a60437f-d87b-4705-ab02-ee352497d7bb"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:52.628260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5a0b4f0f-664e-4137-96cf-9d1ea768d19e req-f6cd6699-86f3-4fc7-a9bf-f708e292ddaf service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:52.628740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5a0b4f0f-664e-4137-96cf-9d1ea768d19e req-f6cd6699-86f3-4fc7-a9bf-f708e292ddaf service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:52.629179 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5a0b4f0f-664e-4137-96cf-9d1ea768d19e req-f6cd6699-86f3-4fc7-a9bf-f708e292ddaf service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:52.679494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5a0b4f0f-664e-4137-96cf-9d1ea768d19e req-f6cd6699-86f3-4fc7-a9bf-f708e292ddaf service nova] Creating event network-changed:5a60437f-d87b-4705-ab02-ee352497d7bb for instance 41685b83-a75b-4abc-814c-c9a4424f2c65 on hv-cinder-86020 Oct 06 11:04:52.680106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5a0b4f0f-664e-4137-96cf-9d1ea768d19e req-f6cd6699-86f3-4fc7-a9bf-f708e292ddaf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 11:04:52.680503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5a0b4f0f-664e-4137-96cf-9d1ea768d19e req-f6cd6699-86f3-4fc7-a9bf-f708e292ddaf service nova] Acquired lock "compute-rpcapi-router" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 11:04:52.682232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6c7f058-a738-43ff-ba6e-e8ed9849aff8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:52.682866 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6c7f058-a738-43ff-ba6e-e8ed9849aff8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:52.685118 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6c7f058-a738-43ff-ba6e-e8ed9849aff8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:52.686455 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6c7f058-a738-43ff-ba6e-e8ed9849aff8 None None] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:52.694445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6c7f058-a738-43ff-ba6e-e8ed9849aff8 None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:52.695076 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6c7f058-a738-43ff-ba6e-e8ed9849aff8 None None] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:52.726711 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.compute.rpcapi [None req-b6c7f058-a738-43ff-ba6e-e8ed9849aff8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 06 11:04:52.727956 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6c7f058-a738-43ff-ba6e-e8ed9849aff8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 11:04:52.753335 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b6c7f058-a738-43ff-ba6e-e8ed9849aff8 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.354692 Oct 06 11:04:52.754654 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 65/121] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:52.916751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9220ddbb-88f8-4889-ad33-d47c26361704 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:52.929487 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9220ddbb-88f8-4889-ad33-d47c26361704 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.376290 Oct 06 11:04:52.940712 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 57/122] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:52 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:53.301945 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d9555f89-af05-4d96-8147-bc95bbd6e04c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:53.302653 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d9555f89-af05-4d96-8147-bc95bbd6e04c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:53.308726 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9555f89-af05-4d96-8147-bc95bbd6e04c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:53.309215 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9555f89-af05-4d96-8147-bc95bbd6e04c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:53.309657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9555f89-af05-4d96-8147-bc95bbd6e04c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:53.310353 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9555f89-af05-4d96-8147-bc95bbd6e04c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:53.310811 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9555f89-af05-4d96-8147-bc95bbd6e04c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:53.311238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9555f89-af05-4d96-8147-bc95bbd6e04c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:53.316223 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:53.346072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62666acb-a37d-4827-96b7-07b8b6604cbf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:53.346990 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62666acb-a37d-4827-96b7-07b8b6604cbf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:53.353694 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62666acb-a37d-4827-96b7-07b8b6604cbf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:53.354322 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62666acb-a37d-4827-96b7-07b8b6604cbf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:53.354893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62666acb-a37d-4827-96b7-07b8b6604cbf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:53.355795 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62666acb-a37d-4827-96b7-07b8b6604cbf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:53.356418 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62666acb-a37d-4827-96b7-07b8b6604cbf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:53.356910 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62666acb-a37d-4827-96b7-07b8b6604cbf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:53.480644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d9555f89-af05-4d96-8147-bc95bbd6e04c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:53.490018 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d9555f89-af05-4d96-8147-bc95bbd6e04c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.192488 Oct 06 11:04:53.490611 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 66/123] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:53 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:53.497908 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-9239a66c-bf67-4418-a733-8dd9cf7022b9 req-7b29d2a8-92d1-4e52-bbfe-10dbecc7495e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9864b6-cb13-4dc0-97d2-e155a1717ec9", "tag": "50343d2f-ca78-433a-93c4-aaa96d6e2a26"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:53.511355 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-62666acb-a37d-4827-96b7-07b8b6604cbf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:53.516529 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9239a66c-bf67-4418-a733-8dd9cf7022b9 req-7b29d2a8-92d1-4e52-bbfe-10dbecc7495e service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:53.517012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9239a66c-bf67-4418-a733-8dd9cf7022b9 req-7b29d2a8-92d1-4e52-bbfe-10dbecc7495e service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:53.517438 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9239a66c-bf67-4418-a733-8dd9cf7022b9 req-7b29d2a8-92d1-4e52-bbfe-10dbecc7495e service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:53.521683 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62666acb-a37d-4827-96b7-07b8b6604cbf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.179618 Oct 06 11:04:53.521959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 58/124] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:53 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:53.537225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:53.537986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-9239a66c-bf67-4418-a733-8dd9cf7022b9 req-7b29d2a8-92d1-4e52-bbfe-10dbecc7495e service nova] Creating event network-changed:50343d2f-ca78-433a-93c4-aaa96d6e2a26 for instance ec9864b6-cb13-4dc0-97d2-e155a1717ec9 on hv-cinder-86020 Oct 06 11:04:53.538118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:53.543458 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-9239a66c-bf67-4418-a733-8dd9cf7022b9 req-7b29d2a8-92d1-4e52-bbfe-10dbecc7495e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051152 Oct 06 11:04:53.544890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 67/125] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:53.545233 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:53.545711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:53.546222 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:53.547739 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:53.548446 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:53.548907 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:53.683431 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:53.692237 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:53.693917 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:53.695279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10f234ca-c601-4d5a-b4ab-933de562210b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.171530 Oct 06 11:04:53.695528 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 59/126] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:53 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:53.955624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0dd514d6-6029-424d-b891-71d51f9c3709 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:53.959729 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0dd514d6-6029-424d-b891-71d51f9c3709 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:53.965983 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd514d6-6029-424d-b891-71d51f9c3709 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:53.966466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd514d6-6029-424d-b891-71d51f9c3709 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:53.967181 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd514d6-6029-424d-b891-71d51f9c3709 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:53.967596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd514d6-6029-424d-b891-71d51f9c3709 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:53.968102 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd514d6-6029-424d-b891-71d51f9c3709 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:53.968651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd514d6-6029-424d-b891-71d51f9c3709 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:54.106198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0dd514d6-6029-424d-b891-71d51f9c3709 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:54.115879 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0dd514d6-6029-424d-b891-71d51f9c3709 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.165165 Oct 06 11:04:54.116867 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 68/127] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:53 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:54.515333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33745f96-990e-45ee-8b53-4768644cafd4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:54.516055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33745f96-990e-45ee-8b53-4768644cafd4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:54.522798 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33745f96-990e-45ee-8b53-4768644cafd4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:54.523284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33745f96-990e-45ee-8b53-4768644cafd4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:54.523770 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33745f96-990e-45ee-8b53-4768644cafd4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:54.528145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33745f96-990e-45ee-8b53-4768644cafd4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:54.528626 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33745f96-990e-45ee-8b53-4768644cafd4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:54.529068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33745f96-990e-45ee-8b53-4768644cafd4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:54.545017 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40a5fb1b-c069-451c-80dd-d909ce1d2ef8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:54.545732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40a5fb1b-c069-451c-80dd-d909ce1d2ef8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:54.554456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40a5fb1b-c069-451c-80dd-d909ce1d2ef8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:54.555300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40a5fb1b-c069-451c-80dd-d909ce1d2ef8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:54.556039 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40a5fb1b-c069-451c-80dd-d909ce1d2ef8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:54.556975 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40a5fb1b-c069-451c-80dd-d909ce1d2ef8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:54.557790 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40a5fb1b-c069-451c-80dd-d909ce1d2ef8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:54.558550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40a5fb1b-c069-451c-80dd-d909ce1d2ef8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:54.879345 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-40a5fb1b-c069-451c-80dd-d909ce1d2ef8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:54.886863 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40a5fb1b-c069-451c-80dd-d909ce1d2ef8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.346410 Oct 06 11:04:54.887433 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 69/128] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:54 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:54.892543 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:54.893151 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:54.899022 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:54.899509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:54.900103 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:54.900675 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:54.901129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:54.901556 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:54.946117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-33745f96-990e-45ee-8b53-4768644cafd4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:54.954083 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33745f96-990e-45ee-8b53-4768644cafd4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.443354 Oct 06 11:04:54.954676 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 60/129] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:54 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:54.972284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-afb9526a-5805-4133-af4e-a1351d1b6fac req-bebd116e-7512-499e-9854-8e6549c5ed17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de15d8c-124c-4827-839a-89d209f344e8", "tag": "3dad21ae-1cb8-4cb8-b40b-12d49df819af"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:54.983355 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afb9526a-5805-4133-af4e-a1351d1b6fac req-bebd116e-7512-499e-9854-8e6549c5ed17 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:54.984819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afb9526a-5805-4133-af4e-a1351d1b6fac req-bebd116e-7512-499e-9854-8e6549c5ed17 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:54.985465 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afb9526a-5805-4133-af4e-a1351d1b6fac req-bebd116e-7512-499e-9854-8e6549c5ed17 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:55.000073 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-afb9526a-5805-4133-af4e-a1351d1b6fac req-bebd116e-7512-499e-9854-8e6549c5ed17 service nova] Creating event network-changed:3dad21ae-1cb8-4cb8-b40b-12d49df819af for instance 9de15d8c-124c-4827-839a-89d209f344e8 on hv-cinder-86020 Oct 06 11:04:55.006615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-afb9526a-5805-4133-af4e-a1351d1b6fac req-bebd116e-7512-499e-9854-8e6549c5ed17 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050447 Oct 06 11:04:55.007650 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 61/130] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:04:55.139716 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c2b7fcfd-8e84-4870-86b9-1deb9b12d167 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:55.141003 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c2b7fcfd-8e84-4870-86b9-1deb9b12d167 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:55.148830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2b7fcfd-8e84-4870-86b9-1deb9b12d167 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:55.149326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2b7fcfd-8e84-4870-86b9-1deb9b12d167 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:55.149823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2b7fcfd-8e84-4870-86b9-1deb9b12d167 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:55.150527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2b7fcfd-8e84-4870-86b9-1deb9b12d167 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:55.151000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2b7fcfd-8e84-4870-86b9-1deb9b12d167 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:55.151412 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2b7fcfd-8e84-4870-86b9-1deb9b12d167 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:55.250360 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:55.258730 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:55.260357 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:55.261456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5caf6dd2-c708-44aa-918a-0757d2066938 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.373089 Oct 06 11:04:55.262258 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 70/131] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:54 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:55.885987 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c2b7fcfd-8e84-4870-86b9-1deb9b12d167 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:55.898540 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c2b7fcfd-8e84-4870-86b9-1deb9b12d167 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.763556 Oct 06 11:04:55.899229 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 62/132] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:55 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:55.916007 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-60d7920c-9a3a-4b4d-9fd2-09c8b3be43c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:55.917617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-60d7920c-9a3a-4b4d-9fd2-09c8b3be43c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:55.925703 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60d7920c-9a3a-4b4d-9fd2-09c8b3be43c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:55.926207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60d7920c-9a3a-4b4d-9fd2-09c8b3be43c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:55.926644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60d7920c-9a3a-4b4d-9fd2-09c8b3be43c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:55.927570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60d7920c-9a3a-4b4d-9fd2-09c8b3be43c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:55.928051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60d7920c-9a3a-4b4d-9fd2-09c8b3be43c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:55.928472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60d7920c-9a3a-4b4d-9fd2-09c8b3be43c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:55.978267 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8fb58f9-1416-420e-a09c-c79f357778df tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:55.979033 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8fb58f9-1416-420e-a09c-c79f357778df tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:55.997823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fb58f9-1416-420e-a09c-c79f357778df tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:55.998622 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fb58f9-1416-420e-a09c-c79f357778df tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:55.999272 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fb58f9-1416-420e-a09c-c79f357778df tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:56.001219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fb58f9-1416-420e-a09c-c79f357778df tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:56.001899 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fb58f9-1416-420e-a09c-c79f357778df tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:56.002362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fb58f9-1416-420e-a09c-c79f357778df tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:56.092273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-60d7920c-9a3a-4b4d-9fd2-09c8b3be43c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:56.102230 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-60d7920c-9a3a-4b4d-9fd2-09c8b3be43c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.191099 Oct 06 11:04:56.117072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 71/133] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:55 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:56.251248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8fb58f9-1416-420e-a09c-c79f357778df tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:56.261515 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8fb58f9-1416-420e-a09c-c79f357778df tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.287299 Oct 06 11:04:56.270275 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 63/134] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:55 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:56.289265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:56.290131 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:56.296122 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:56.297451 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:56.298060 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:56.298919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:56.299641 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:56.300240 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:56.480381 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:56.489846 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:56.491335 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:56.492443 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10469a43-d1c4-4f6b-8882-9c5de83c203a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.207927 Oct 06 11:04:56.493015 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 72/135] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:56 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:56.925305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-475f4441-71d3-4589-97f0-30a27f23bca1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:56.925961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-475f4441-71d3-4589-97f0-30a27f23bca1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:56.931920 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-475f4441-71d3-4589-97f0-30a27f23bca1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:56.932412 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-475f4441-71d3-4589-97f0-30a27f23bca1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:56.932858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-475f4441-71d3-4589-97f0-30a27f23bca1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:56.933553 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-475f4441-71d3-4589-97f0-30a27f23bca1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:56.934004 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-475f4441-71d3-4589-97f0-30a27f23bca1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:56.934427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-475f4441-71d3-4589-97f0-30a27f23bca1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:57.024305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-47caa699-acbc-45ff-96c7-f8309e61b33d req-ca88a067-28e1-4399-a375-74b1560832b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9fceeb-0987-4e4f-b34b-f524fa791d3b", "tag": "e16aada9-7c39-402c-9979-d8f302e4c39a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:04:57.047066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-47caa699-acbc-45ff-96c7-f8309e61b33d req-ca88a067-28e1-4399-a375-74b1560832b8 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:57.047695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-47caa699-acbc-45ff-96c7-f8309e61b33d req-ca88a067-28e1-4399-a375-74b1560832b8 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:57.048022 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-47caa699-acbc-45ff-96c7-f8309e61b33d req-ca88a067-28e1-4399-a375-74b1560832b8 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:57.060482 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-47caa699-acbc-45ff-96c7-f8309e61b33d req-ca88a067-28e1-4399-a375-74b1560832b8 service nova] Creating event network-changed:e16aada9-7c39-402c-9979-d8f302e4c39a for instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b on hv-cinder-86020 Oct 06 11:04:57.066058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-47caa699-acbc-45ff-96c7-f8309e61b33d req-ca88a067-28e1-4399-a375-74b1560832b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045641 Oct 06 11:04:57.066661 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 73/136] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:04:57.089924 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-475f4441-71d3-4589-97f0-30a27f23bca1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:57.097802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-475f4441-71d3-4589-97f0-30a27f23bca1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.176713 Oct 06 11:04:57.098375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 64/137] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:56 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:57.130133 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bbd6890-5556-4a63-bd14-a37da17d797b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:57.130836 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7bbd6890-5556-4a63-bd14-a37da17d797b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:57.136789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbd6890-5556-4a63-bd14-a37da17d797b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:57.137265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbd6890-5556-4a63-bd14-a37da17d797b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:57.137694 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbd6890-5556-4a63-bd14-a37da17d797b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:57.138367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbd6890-5556-4a63-bd14-a37da17d797b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:57.138857 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbd6890-5556-4a63-bd14-a37da17d797b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:57.139248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbd6890-5556-4a63-bd14-a37da17d797b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:57.270369 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7bbd6890-5556-4a63-bd14-a37da17d797b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:57.278408 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7bbd6890-5556-4a63-bd14-a37da17d797b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.153022 Oct 06 11:04:57.278972 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 74/138] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:57 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:57.288903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08fad4ec-53e2-4086-82da-33799ef5ccf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:57.289555 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-08fad4ec-53e2-4086-82da-33799ef5ccf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:57.295527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08fad4ec-53e2-4086-82da-33799ef5ccf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:57.296041 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08fad4ec-53e2-4086-82da-33799ef5ccf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:57.296476 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08fad4ec-53e2-4086-82da-33799ef5ccf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:57.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08fad4ec-53e2-4086-82da-33799ef5ccf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:57.297604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08fad4ec-53e2-4086-82da-33799ef5ccf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:57.298534 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08fad4ec-53e2-4086-82da-33799ef5ccf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:57.303554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:57.433143 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-08fad4ec-53e2-4086-82da-33799ef5ccf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:57.442535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08fad4ec-53e2-4086-82da-33799ef5ccf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.157359 Oct 06 11:04:57.443332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 65/139] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:57 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:57.517629 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:57.518448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:57.525682 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:57.526164 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:57.527054 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:57.527771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:57.528232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:57.528651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:57.695497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:57.711058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:57.713337 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:57.714732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8194a222-cec1-4a84-8fa9-950a2c2e1150 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.201338 Oct 06 11:04:57.716225 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 75/140] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:57 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:58.124250 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6989da55-873c-4d14-be34-a463c405e7fc tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:58.125669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6989da55-873c-4d14-be34-a463c405e7fc tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:58.133493 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6989da55-873c-4d14-be34-a463c405e7fc tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:58.133988 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6989da55-873c-4d14-be34-a463c405e7fc tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:58.134451 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6989da55-873c-4d14-be34-a463c405e7fc tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:58.135107 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6989da55-873c-4d14-be34-a463c405e7fc tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:58.135721 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6989da55-873c-4d14-be34-a463c405e7fc tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:58.136195 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6989da55-873c-4d14-be34-a463c405e7fc tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:58.283878 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6989da55-873c-4d14-be34-a463c405e7fc tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:58.294133 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6989da55-873c-4d14-be34-a463c405e7fc tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.177074 Oct 06 11:04:58.295008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 66/141] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:58 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:58.305655 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37f497ec-546b-47b4-87c4-13789a5e842e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:58.306462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37f497ec-546b-47b4-87c4-13789a5e842e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:58.312786 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37f497ec-546b-47b4-87c4-13789a5e842e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:58.313499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37f497ec-546b-47b4-87c4-13789a5e842e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:58.314628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37f497ec-546b-47b4-87c4-13789a5e842e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:58.315572 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37f497ec-546b-47b4-87c4-13789a5e842e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:58.316398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37f497ec-546b-47b4-87c4-13789a5e842e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:58.317023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37f497ec-546b-47b4-87c4-13789a5e842e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:58.467061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14eefa57-c1f1-48b9-91ce-590476788c1e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:58.467878 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14eefa57-c1f1-48b9-91ce-590476788c1e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:58.476898 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14eefa57-c1f1-48b9-91ce-590476788c1e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:58.478069 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14eefa57-c1f1-48b9-91ce-590476788c1e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:58.478526 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14eefa57-c1f1-48b9-91ce-590476788c1e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:58.479374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14eefa57-c1f1-48b9-91ce-590476788c1e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:58.479866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14eefa57-c1f1-48b9-91ce-590476788c1e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:58.480296 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14eefa57-c1f1-48b9-91ce-590476788c1e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:58.518574 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-37f497ec-546b-47b4-87c4-13789a5e842e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:58.528805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37f497ec-546b-47b4-87c4-13789a5e842e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.228209 Oct 06 11:04:58.529474 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 76/142] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:58 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:58.715027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-14eefa57-c1f1-48b9-91ce-590476788c1e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:58.725036 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14eefa57-c1f1-48b9-91ce-590476788c1e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.262074 Oct 06 11:04:58.725706 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 67/143] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:58 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:04:58.743332 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:58.744002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:58.757268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:58.757780 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:58.758284 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:58.759004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:58.759457 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:58.760029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:58.935636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:58.945180 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:58.946614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:58.947933 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e0196d4-57b8-40de-b0a8-17e126415f5d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.208907 Oct 06 11:04:58.948660 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 77/144] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:58 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:04:59.320744 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3a48e4e-ad65-4cde-83ea-6284f4dff675 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:59.323733 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3a48e4e-ad65-4cde-83ea-6284f4dff675 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:59.336331 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a48e4e-ad65-4cde-83ea-6284f4dff675 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:59.341501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a48e4e-ad65-4cde-83ea-6284f4dff675 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:59.342281 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a48e4e-ad65-4cde-83ea-6284f4dff675 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:59.343806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a48e4e-ad65-4cde-83ea-6284f4dff675 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:59.344344 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a48e4e-ad65-4cde-83ea-6284f4dff675 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:59.346282 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a48e4e-ad65-4cde-83ea-6284f4dff675 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:59.500017 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3a48e4e-ad65-4cde-83ea-6284f4dff675 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:59.509481 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3a48e4e-ad65-4cde-83ea-6284f4dff675 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.194013 Oct 06 11:04:59.522715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 68/145] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:59 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:59.554567 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d7fa4ade-ab3c-4fd8-be59-1d1a282b49e4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:59.555405 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d7fa4ade-ab3c-4fd8-be59-1d1a282b49e4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:59.563128 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7fa4ade-ab3c-4fd8-be59-1d1a282b49e4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:59.564592 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7fa4ade-ab3c-4fd8-be59-1d1a282b49e4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:59.565200 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7fa4ade-ab3c-4fd8-be59-1d1a282b49e4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:59.566322 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7fa4ade-ab3c-4fd8-be59-1d1a282b49e4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:59.566534 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7fa4ade-ab3c-4fd8-be59-1d1a282b49e4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:59.567123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7fa4ade-ab3c-4fd8-be59-1d1a282b49e4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:59.728336 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d7fa4ade-ab3c-4fd8-be59-1d1a282b49e4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:59.737166 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d7fa4ade-ab3c-4fd8-be59-1d1a282b49e4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.186463 Oct 06 11:04:59.738470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 78/146] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:59 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:59.756109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2dd75aa1-8b0a-41dc-ae93-5851dc4cdbd8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:59.756808 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2dd75aa1-8b0a-41dc-ae93-5851dc4cdbd8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:59.762730 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dd75aa1-8b0a-41dc-ae93-5851dc4cdbd8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:59.763318 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dd75aa1-8b0a-41dc-ae93-5851dc4cdbd8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:59.763810 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dd75aa1-8b0a-41dc-ae93-5851dc4cdbd8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:59.764754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dd75aa1-8b0a-41dc-ae93-5851dc4cdbd8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:59.765088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dd75aa1-8b0a-41dc-ae93-5851dc4cdbd8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:59.765467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dd75aa1-8b0a-41dc-ae93-5851dc4cdbd8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:59.911949 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dd75aa1-8b0a-41dc-ae93-5851dc4cdbd8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:04:59.920515 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2dd75aa1-8b0a-41dc-ae93-5851dc4cdbd8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.168212 Oct 06 11:04:59.921190 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 69/147] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:04:59 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:04:59.973551 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:04:59.974497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:04:59.977713 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:59.982126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:59.982619 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:59.983056 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:04:59.983759 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:04:59.984256 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:04:59.984810 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:00.130897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:00.139325 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:00.141433 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:00.143209 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e4cefd24-a8c2-4940-bddd-226cd77e62da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.174099 Oct 06 11:05:00.143762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 79/148] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:04:59 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:00.532910 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2547544a-c5b5-4fad-8f6c-1bdeff5c94d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:00.534111 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2547544a-c5b5-4fad-8f6c-1bdeff5c94d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:00.540690 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2547544a-c5b5-4fad-8f6c-1bdeff5c94d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:00.541189 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2547544a-c5b5-4fad-8f6c-1bdeff5c94d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:00.541631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2547544a-c5b5-4fad-8f6c-1bdeff5c94d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:00.542472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2547544a-c5b5-4fad-8f6c-1bdeff5c94d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:00.543088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2547544a-c5b5-4fad-8f6c-1bdeff5c94d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:00.543790 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2547544a-c5b5-4fad-8f6c-1bdeff5c94d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:00.687271 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2547544a-c5b5-4fad-8f6c-1bdeff5c94d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:00.695728 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2547544a-c5b5-4fad-8f6c-1bdeff5c94d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.167011 Oct 06 11:05:00.696711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 70/149] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:00 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:00.762776 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62212927-b24b-4558-83a7-b9a921fd5647 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:00.763389 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62212927-b24b-4558-83a7-b9a921fd5647 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:00.770221 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62212927-b24b-4558-83a7-b9a921fd5647 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:00.770899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62212927-b24b-4558-83a7-b9a921fd5647 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:00.771330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62212927-b24b-4558-83a7-b9a921fd5647 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:00.772228 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62212927-b24b-4558-83a7-b9a921fd5647 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:00.772933 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62212927-b24b-4558-83a7-b9a921fd5647 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:00.773353 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62212927-b24b-4558-83a7-b9a921fd5647 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:00.915444 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-62212927-b24b-4558-83a7-b9a921fd5647 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:00.923916 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62212927-b24b-4558-83a7-b9a921fd5647 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.164773 Oct 06 11:05:00.924505 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 80/150] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:00 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:00.946344 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-74f31813-21eb-45eb-a2d2-b8031352e159 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:00.946951 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-74f31813-21eb-45eb-a2d2-b8031352e159 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:00.953647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74f31813-21eb-45eb-a2d2-b8031352e159 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:00.955233 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74f31813-21eb-45eb-a2d2-b8031352e159 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:00.955684 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74f31813-21eb-45eb-a2d2-b8031352e159 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:00.956429 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74f31813-21eb-45eb-a2d2-b8031352e159 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:00.956882 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74f31813-21eb-45eb-a2d2-b8031352e159 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:00.957300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74f31813-21eb-45eb-a2d2-b8031352e159 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:01.100076 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-74f31813-21eb-45eb-a2d2-b8031352e159 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:01.109980 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-74f31813-21eb-45eb-a2d2-b8031352e159 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.167807 Oct 06 11:05:01.111104 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 71/151] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:00 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:01.177016 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:01.177698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:01.199297 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:01.199774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:01.201141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:01.202155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:01.202638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:01.203190 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:01.345965 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:01.354562 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:01.356630 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:01.357910 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-30050882-878b-4266-864f-5334bb48e214 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.189230 Oct 06 11:05:01.358717 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 81/152] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:01 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:01.728814 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-491d5570-fea5-415e-9dfc-5a6dbbc1b78a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:01.730816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-491d5570-fea5-415e-9dfc-5a6dbbc1b78a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:01.733774 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:01.743645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491d5570-fea5-415e-9dfc-5a6dbbc1b78a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:01.743645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491d5570-fea5-415e-9dfc-5a6dbbc1b78a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:01.743645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491d5570-fea5-415e-9dfc-5a6dbbc1b78a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:01.743645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491d5570-fea5-415e-9dfc-5a6dbbc1b78a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:01.744044 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491d5570-fea5-415e-9dfc-5a6dbbc1b78a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:01.744265 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491d5570-fea5-415e-9dfc-5a6dbbc1b78a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:01.906652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-491d5570-fea5-415e-9dfc-5a6dbbc1b78a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:01.921099 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-491d5570-fea5-415e-9dfc-5a6dbbc1b78a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.201348 Oct 06 11:05:01.921751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 72/153] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:01 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:01.949149 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3eaf03d5-e120-4537-8be8-5d3b72e945d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:01.949765 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3eaf03d5-e120-4537-8be8-5d3b72e945d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:01.957282 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eaf03d5-e120-4537-8be8-5d3b72e945d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:01.957772 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eaf03d5-e120-4537-8be8-5d3b72e945d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:01.958711 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eaf03d5-e120-4537-8be8-5d3b72e945d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:01.959447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eaf03d5-e120-4537-8be8-5d3b72e945d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:01.959905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eaf03d5-e120-4537-8be8-5d3b72e945d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:01.960330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eaf03d5-e120-4537-8be8-5d3b72e945d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:02.135247 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab04bce4-ae92-42d2-b50c-b2d99fb79bf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:02.135780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab04bce4-ae92-42d2-b50c-b2d99fb79bf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:02.148102 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab04bce4-ae92-42d2-b50c-b2d99fb79bf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:02.148642 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab04bce4-ae92-42d2-b50c-b2d99fb79bf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:02.150005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab04bce4-ae92-42d2-b50c-b2d99fb79bf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:02.160214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab04bce4-ae92-42d2-b50c-b2d99fb79bf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:02.160713 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab04bce4-ae92-42d2-b50c-b2d99fb79bf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:02.161159 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab04bce4-ae92-42d2-b50c-b2d99fb79bf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:02.280079 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3eaf03d5-e120-4537-8be8-5d3b72e945d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:02.289473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3eaf03d5-e120-4537-8be8-5d3b72e945d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.344234 Oct 06 11:05:02.305144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 82/154] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:01 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:02.386160 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:02.387064 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:02.395504 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:02.396137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:02.396783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:02.397939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:02.398599 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:02.399391 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:02.434604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab04bce4-ae92-42d2-b50c-b2d99fb79bf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:02.445627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab04bce4-ae92-42d2-b50c-b2d99fb79bf0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.313423 Oct 06 11:05:02.446540 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 73/155] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:02 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:02.603783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:02.620954 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:02.624402 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:02.628355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9cc321c8-a025-46d9-9eba-34945703d084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.248284 Oct 06 11:05:02.631353 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 83/156] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:02 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:02.946045 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fad4651d-1975-47ee-87f8-88eb49199310 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:02.946669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fad4651d-1975-47ee-87f8-88eb49199310 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:02.955746 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fad4651d-1975-47ee-87f8-88eb49199310 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:02.956307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fad4651d-1975-47ee-87f8-88eb49199310 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:02.956744 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fad4651d-1975-47ee-87f8-88eb49199310 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:02.957441 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fad4651d-1975-47ee-87f8-88eb49199310 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:02.958970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fad4651d-1975-47ee-87f8-88eb49199310 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:02.959577 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fad4651d-1975-47ee-87f8-88eb49199310 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:03.209760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fad4651d-1975-47ee-87f8-88eb49199310 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:03.217970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fad4651d-1975-47ee-87f8-88eb49199310 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.277222 Oct 06 11:05:03.218628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 74/157] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:02 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:03.312752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-371cce9b-5837-4627-9eb5-6da3ef7c9d1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:03.313530 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-371cce9b-5837-4627-9eb5-6da3ef7c9d1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:03.317902 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:03.321902 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-371cce9b-5837-4627-9eb5-6da3ef7c9d1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:03.322743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-371cce9b-5837-4627-9eb5-6da3ef7c9d1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:03.323538 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-371cce9b-5837-4627-9eb5-6da3ef7c9d1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:03.324277 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-371cce9b-5837-4627-9eb5-6da3ef7c9d1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:03.324803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-371cce9b-5837-4627-9eb5-6da3ef7c9d1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:03.325300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-371cce9b-5837-4627-9eb5-6da3ef7c9d1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:03.330964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:03.469494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7788f9e3-1870-4cce-9f6d-6bf83b2260f7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:03.470434 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7788f9e3-1870-4cce-9f6d-6bf83b2260f7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:03.479876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7788f9e3-1870-4cce-9f6d-6bf83b2260f7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:03.480585 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7788f9e3-1870-4cce-9f6d-6bf83b2260f7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:03.484440 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7788f9e3-1870-4cce-9f6d-6bf83b2260f7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:03.486036 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7788f9e3-1870-4cce-9f6d-6bf83b2260f7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:03.487635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7788f9e3-1870-4cce-9f6d-6bf83b2260f7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:03.488301 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7788f9e3-1870-4cce-9f6d-6bf83b2260f7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:03.504478 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-371cce9b-5837-4627-9eb5-6da3ef7c9d1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:03.512756 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-371cce9b-5837-4627-9eb5-6da3ef7c9d1c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.203867 Oct 06 11:05:03.513527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 84/158] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:03 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:03.663942 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:03.664787 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:03.676999 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:03.677503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:03.678090 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:03.678936 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:03.679529 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:03.680115 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:03.811868 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7788f9e3-1870-4cce-9f6d-6bf83b2260f7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:03.830935 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7788f9e3-1870-4cce-9f6d-6bf83b2260f7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.364522 Oct 06 11:05:03.831964 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 75/159] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:03 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:03.926779 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:03.937994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:03.940804 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:03.941932 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7bc3ce90-29ba-488a-ada5-5f0295eec8bf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.284062 Oct 06 11:05:03.942642 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 85/160] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:03 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:04.243421 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd9f5fce-d506-4a0d-8148-a91ff6b9751f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:04.244251 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd9f5fce-d506-4a0d-8148-a91ff6b9751f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:04.250650 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9f5fce-d506-4a0d-8148-a91ff6b9751f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:04.251422 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9f5fce-d506-4a0d-8148-a91ff6b9751f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:04.252378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9f5fce-d506-4a0d-8148-a91ff6b9751f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:04.253456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9f5fce-d506-4a0d-8148-a91ff6b9751f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:04.253923 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9f5fce-d506-4a0d-8148-a91ff6b9751f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:04.254353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9f5fce-d506-4a0d-8148-a91ff6b9751f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:04.402779 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd9f5fce-d506-4a0d-8148-a91ff6b9751f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:04.411070 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd9f5fce-d506-4a0d-8148-a91ff6b9751f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.172816 Oct 06 11:05:04.411989 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 76/161] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:04 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:04.537596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cd0a008a-7ac4-46ea-954a-8b298a4fab86 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:04.538204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cd0a008a-7ac4-46ea-954a-8b298a4fab86 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:04.544509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0a008a-7ac4-46ea-954a-8b298a4fab86 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:04.545250 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0a008a-7ac4-46ea-954a-8b298a4fab86 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:04.545734 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0a008a-7ac4-46ea-954a-8b298a4fab86 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:04.546582 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0a008a-7ac4-46ea-954a-8b298a4fab86 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:04.547179 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0a008a-7ac4-46ea-954a-8b298a4fab86 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:04.547760 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0a008a-7ac4-46ea-954a-8b298a4fab86 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:04.684883 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd0a008a-7ac4-46ea-954a-8b298a4fab86 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:04.693341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cd0a008a-7ac4-46ea-954a-8b298a4fab86 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.160408 Oct 06 11:05:04.694012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 86/162] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:04 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:04.856672 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d529c2b0-b5d3-4c7c-821c-34607916d5b2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:04.857264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d529c2b0-b5d3-4c7c-821c-34607916d5b2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:04.864162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d529c2b0-b5d3-4c7c-821c-34607916d5b2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:04.864648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d529c2b0-b5d3-4c7c-821c-34607916d5b2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:04.865076 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d529c2b0-b5d3-4c7c-821c-34607916d5b2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:04.865996 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d529c2b0-b5d3-4c7c-821c-34607916d5b2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:04.866590 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d529c2b0-b5d3-4c7c-821c-34607916d5b2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:04.867190 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d529c2b0-b5d3-4c7c-821c-34607916d5b2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:04.971818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:04.975252 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:04.984039 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:04.984934 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:04.986214 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:04.987342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:04.988100 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:04.988534 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:05.054634 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d529c2b0-b5d3-4c7c-821c-34607916d5b2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:05.066939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d529c2b0-b5d3-4c7c-821c-34607916d5b2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.214216 Oct 06 11:05:05.067696 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 77/163] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:04 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:05.176859 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:05.186159 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:05.187909 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:05.189839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f6c0fe3-b363-4037-bd32-d147a157e499 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.222316 Oct 06 11:05:05.190389 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 87/164] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:04 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:05.435181 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c04ac6b6-2ca8-480b-a3ad-d2eda85b1401 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:05.435881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c04ac6b6-2ca8-480b-a3ad-d2eda85b1401 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:05.442469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c04ac6b6-2ca8-480b-a3ad-d2eda85b1401 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:05.442961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c04ac6b6-2ca8-480b-a3ad-d2eda85b1401 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:05.443395 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c04ac6b6-2ca8-480b-a3ad-d2eda85b1401 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:05.444111 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c04ac6b6-2ca8-480b-a3ad-d2eda85b1401 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:05.444611 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c04ac6b6-2ca8-480b-a3ad-d2eda85b1401 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:05.444958 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c04ac6b6-2ca8-480b-a3ad-d2eda85b1401 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:05.609789 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c04ac6b6-2ca8-480b-a3ad-d2eda85b1401 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:05.619158 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c04ac6b6-2ca8-480b-a3ad-d2eda85b1401 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.188507 Oct 06 11:05:05.620439 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 78/165] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:05 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:05.717812 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a9d11c3-b612-4c42-b8d8-2cfe22b79dc5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:05.718490 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8a9d11c3-b612-4c42-b8d8-2cfe22b79dc5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:05.725132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9d11c3-b612-4c42-b8d8-2cfe22b79dc5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:05.725697 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9d11c3-b612-4c42-b8d8-2cfe22b79dc5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:05.726210 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9d11c3-b612-4c42-b8d8-2cfe22b79dc5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:05.727170 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9d11c3-b612-4c42-b8d8-2cfe22b79dc5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:05.727719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9d11c3-b612-4c42-b8d8-2cfe22b79dc5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:05.728238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9d11c3-b612-4c42-b8d8-2cfe22b79dc5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:05.885378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a9d11c3-b612-4c42-b8d8-2cfe22b79dc5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:05.897812 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a9d11c3-b612-4c42-b8d8-2cfe22b79dc5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.183203 Oct 06 11:05:05.898732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 88/166] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:05 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:06.093248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bc4a7dc-43d5-44a6-962b-dd6747fec81f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:06.094219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bc4a7dc-43d5-44a6-962b-dd6747fec81f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:06.101554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc4a7dc-43d5-44a6-962b-dd6747fec81f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:06.102429 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc4a7dc-43d5-44a6-962b-dd6747fec81f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:06.102890 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc4a7dc-43d5-44a6-962b-dd6747fec81f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:06.103754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc4a7dc-43d5-44a6-962b-dd6747fec81f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:06.104650 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc4a7dc-43d5-44a6-962b-dd6747fec81f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:06.105080 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc4a7dc-43d5-44a6-962b-dd6747fec81f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:06.225081 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:06.225714 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:06.231752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:06.232621 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:06.233110 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:06.233866 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:06.234323 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:06.234748 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:06.312614 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0bc4a7dc-43d5-44a6-962b-dd6747fec81f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:06.321775 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bc4a7dc-43d5-44a6-962b-dd6747fec81f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.233584 Oct 06 11:05:06.322578 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 79/167] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:06 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:06.379653 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:06.387867 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:06.389345 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:06.393665 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19e7c462-37ea-4405-a825-692d2252d033 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.178043 Oct 06 11:05:06.408553 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 89/168] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:06 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:06.643280 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9ad3729-e261-4d15-9347-2747ff59e100 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:06.645560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b9ad3729-e261-4d15-9347-2747ff59e100 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:06.652159 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9ad3729-e261-4d15-9347-2747ff59e100 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:06.652662 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9ad3729-e261-4d15-9347-2747ff59e100 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:06.653094 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9ad3729-e261-4d15-9347-2747ff59e100 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:06.653923 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9ad3729-e261-4d15-9347-2747ff59e100 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:06.654403 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9ad3729-e261-4d15-9347-2747ff59e100 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:06.654825 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9ad3729-e261-4d15-9347-2747ff59e100 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:06.790950 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b9ad3729-e261-4d15-9347-2747ff59e100 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:06.799582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9ad3729-e261-4d15-9347-2747ff59e100 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.160076 Oct 06 11:05:06.800211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 80/169] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:06 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:06.922128 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c904adc9-2554-4271-8454-618d9f93a556 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:06.923586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c904adc9-2554-4271-8454-618d9f93a556 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:06.929869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c904adc9-2554-4271-8454-618d9f93a556 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:06.930356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c904adc9-2554-4271-8454-618d9f93a556 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:06.930791 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c904adc9-2554-4271-8454-618d9f93a556 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:06.931478 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c904adc9-2554-4271-8454-618d9f93a556 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:06.931955 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c904adc9-2554-4271-8454-618d9f93a556 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:06.932408 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c904adc9-2554-4271-8454-618d9f93a556 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:07.118782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c904adc9-2554-4271-8454-618d9f93a556 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:07.126508 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c904adc9-2554-4271-8454-618d9f93a556 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.208244 Oct 06 11:05:07.127076 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 90/170] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:06 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:07.346464 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dbb37180-6a60-4d1b-845d-12486aa73d7e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:07.347210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dbb37180-6a60-4d1b-845d-12486aa73d7e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:07.349197 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:07.354722 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbb37180-6a60-4d1b-845d-12486aa73d7e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:07.355249 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbb37180-6a60-4d1b-845d-12486aa73d7e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:07.355767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbb37180-6a60-4d1b-845d-12486aa73d7e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:07.356577 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbb37180-6a60-4d1b-845d-12486aa73d7e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:07.357062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbb37180-6a60-4d1b-845d-12486aa73d7e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:07.357496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbb37180-6a60-4d1b-845d-12486aa73d7e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:07.423195 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:07.423195 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:07.424675 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:07.426058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:07.426058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:07.426373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:07.426888 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:07.427479 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:07.516224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dbb37180-6a60-4d1b-845d-12486aa73d7e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:07.519905 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:07.525565 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dbb37180-6a60-4d1b-845d-12486aa73d7e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.183686 Oct 06 11:05:07.526131 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 81/171] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:07 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:07.581590 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:07.589735 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:07.591263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:07.592428 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ac650fdc-c91f-4f9a-8262-945254f0c1d1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.180084 Oct 06 11:05:07.592994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 91/172] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:07 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:07.822296 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f94221bc-9204-4867-9f89-67f8a9a719f0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:07.822914 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f94221bc-9204-4867-9f89-67f8a9a719f0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:07.829501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f94221bc-9204-4867-9f89-67f8a9a719f0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:07.830106 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f94221bc-9204-4867-9f89-67f8a9a719f0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:07.830554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f94221bc-9204-4867-9f89-67f8a9a719f0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:07.831248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f94221bc-9204-4867-9f89-67f8a9a719f0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:07.831705 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f94221bc-9204-4867-9f89-67f8a9a719f0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:07.832169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f94221bc-9204-4867-9f89-67f8a9a719f0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:07.964601 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f94221bc-9204-4867-9f89-67f8a9a719f0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:07.972258 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f94221bc-9204-4867-9f89-67f8a9a719f0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.153672 Oct 06 11:05:07.972832 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 82/173] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:07 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:08.150644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6afb9916-7b6a-4dde-9991-75c67ad2013b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:08.151419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6afb9916-7b6a-4dde-9991-75c67ad2013b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:08.158110 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb9916-7b6a-4dde-9991-75c67ad2013b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:08.158657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb9916-7b6a-4dde-9991-75c67ad2013b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:08.159314 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb9916-7b6a-4dde-9991-75c67ad2013b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:08.160136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb9916-7b6a-4dde-9991-75c67ad2013b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:08.160671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb9916-7b6a-4dde-9991-75c67ad2013b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:08.161140 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb9916-7b6a-4dde-9991-75c67ad2013b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:08.303082 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6afb9916-7b6a-4dde-9991-75c67ad2013b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:08.311343 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6afb9916-7b6a-4dde-9991-75c67ad2013b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.165468 Oct 06 11:05:08.323521 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 92/174] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:08 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:08.548682 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-504c3cee-5463-46b4-8d9f-a1486f0ede56 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:08.549296 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-504c3cee-5463-46b4-8d9f-a1486f0ede56 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:08.555157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-504c3cee-5463-46b4-8d9f-a1486f0ede56 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:08.555644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-504c3cee-5463-46b4-8d9f-a1486f0ede56 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:08.556138 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-504c3cee-5463-46b4-8d9f-a1486f0ede56 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:08.556830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-504c3cee-5463-46b4-8d9f-a1486f0ede56 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:08.557290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-504c3cee-5463-46b4-8d9f-a1486f0ede56 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:08.557717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-504c3cee-5463-46b4-8d9f-a1486f0ede56 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:08.615908 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:08.616907 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:08.623065 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:08.623554 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:08.624023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:08.624714 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:08.625373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:08.626021 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:08.696105 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-504c3cee-5463-46b4-8d9f-a1486f0ede56 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:08.704712 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-504c3cee-5463-46b4-8d9f-a1486f0ede56 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.159292 Oct 06 11:05:08.705291 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 83/175] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:08 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:08.777230 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:08.785920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:08.791579 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:08.792806 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a709cb4c-7e83-4019-b679-92834bf90ad1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.180634 Oct 06 11:05:08.793270 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 93/176] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:08 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:08.995505 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98539b64-0177-43aa-90cc-a3044db7d084 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:08.996341 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-98539b64-0177-43aa-90cc-a3044db7d084 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:09.002843 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98539b64-0177-43aa-90cc-a3044db7d084 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:09.003478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98539b64-0177-43aa-90cc-a3044db7d084 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:09.003936 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98539b64-0177-43aa-90cc-a3044db7d084 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:09.004641 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98539b64-0177-43aa-90cc-a3044db7d084 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:09.005067 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98539b64-0177-43aa-90cc-a3044db7d084 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:09.005484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98539b64-0177-43aa-90cc-a3044db7d084 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:09.144192 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-98539b64-0177-43aa-90cc-a3044db7d084 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:09.152167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-98539b64-0177-43aa-90cc-a3044db7d084 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.160447 Oct 06 11:05:09.152969 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 84/177] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:08 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:09.334139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7fd4e098-a3f0-4d09-8bb1-3102b11a8446 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:09.335137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7fd4e098-a3f0-4d09-8bb1-3102b11a8446 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:09.340671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd4e098-a3f0-4d09-8bb1-3102b11a8446 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:09.341074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd4e098-a3f0-4d09-8bb1-3102b11a8446 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:09.341507 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd4e098-a3f0-4d09-8bb1-3102b11a8446 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:09.342188 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd4e098-a3f0-4d09-8bb1-3102b11a8446 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:09.342636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd4e098-a3f0-4d09-8bb1-3102b11a8446 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:09.343053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd4e098-a3f0-4d09-8bb1-3102b11a8446 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:09.483816 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fd4e098-a3f0-4d09-8bb1-3102b11a8446 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:09.491508 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7fd4e098-a3f0-4d09-8bb1-3102b11a8446 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.161357 Oct 06 11:05:09.492114 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 94/178] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:09 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:09.730548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4eff263f-f65d-4fcd-8d22-2839e9e927a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:09.731159 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4eff263f-f65d-4fcd-8d22-2839e9e927a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:09.737322 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eff263f-f65d-4fcd-8d22-2839e9e927a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:09.737833 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eff263f-f65d-4fcd-8d22-2839e9e927a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:09.738268 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eff263f-f65d-4fcd-8d22-2839e9e927a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:09.738949 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eff263f-f65d-4fcd-8d22-2839e9e927a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:09.739396 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eff263f-f65d-4fcd-8d22-2839e9e927a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:09.739819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eff263f-f65d-4fcd-8d22-2839e9e927a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:09.818019 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:09.818623 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:09.825664 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:09.826637 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:09.826721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:09.827352 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:09.827862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:09.828524 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:09.899141 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4eff263f-f65d-4fcd-8d22-2839e9e927a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:09.909693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4eff263f-f65d-4fcd-8d22-2839e9e927a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.182875 Oct 06 11:05:09.910281 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 85/179] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:09 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:09.981099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:09.990196 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:09.991615 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:09.992747 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f2354c0-8c4d-40ea-8d7a-e43df0d5a3c5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.179298 Oct 06 11:05:09.993601 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 95/180] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:09 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:10.178649 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-506b1edf-1c4d-48ce-82b1-5f0f7d8046bf tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:10.179875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-506b1edf-1c4d-48ce-82b1-5f0f7d8046bf tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:10.185982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506b1edf-1c4d-48ce-82b1-5f0f7d8046bf tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:10.186853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506b1edf-1c4d-48ce-82b1-5f0f7d8046bf tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:10.187723 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506b1edf-1c4d-48ce-82b1-5f0f7d8046bf tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:10.189070 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506b1edf-1c4d-48ce-82b1-5f0f7d8046bf tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:10.189853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506b1edf-1c4d-48ce-82b1-5f0f7d8046bf tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:10.190846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506b1edf-1c4d-48ce-82b1-5f0f7d8046bf tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:10.370966 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6367d0ac-c2ba-4c67-bb17-c4852fdf4c8e req-c3873819-1a28-463d-891f-45d86431aee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb86039-b159-435a-b022-4396a59b657c", "name": "network-vif-plugged", "status": "completed", "tag": "f595a1a4-6f82-46d6-9c95-1fd836a18532"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:05:10.382788 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6367d0ac-c2ba-4c67-bb17-c4852fdf4c8e req-c3873819-1a28-463d-891f-45d86431aee1 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:10.384140 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6367d0ac-c2ba-4c67-bb17-c4852fdf4c8e req-c3873819-1a28-463d-891f-45d86431aee1 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:10.384869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6367d0ac-c2ba-4c67-bb17-c4852fdf4c8e req-c3873819-1a28-463d-891f-45d86431aee1 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:10.398365 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6367d0ac-c2ba-4c67-bb17-c4852fdf4c8e req-c3873819-1a28-463d-891f-45d86431aee1 service nova] Creating event network-vif-plugged:f595a1a4-6f82-46d6-9c95-1fd836a18532 for instance 3eb86039-b159-435a-b022-4396a59b657c on hv-cinder-86020 Oct 06 11:05:10.404116 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6367d0ac-c2ba-4c67-bb17-c4852fdf4c8e req-c3873819-1a28-463d-891f-45d86431aee1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106378 Oct 06 11:05:10.404726 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 96/181] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:05:10.432748 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-506b1edf-1c4d-48ce-82b1-5f0f7d8046bf tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:10.443143 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-506b1edf-1c4d-48ce-82b1-5f0f7d8046bf tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.270062 Oct 06 11:05:10.445187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 86/182] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:10 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:10.515223 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ea72b172-1e1d-4d4f-810c-1b08aea51074 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:10.516158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ea72b172-1e1d-4d4f-810c-1b08aea51074 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:10.523975 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea72b172-1e1d-4d4f-810c-1b08aea51074 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:10.523975 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea72b172-1e1d-4d4f-810c-1b08aea51074 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:10.524295 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea72b172-1e1d-4d4f-810c-1b08aea51074 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:10.525850 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea72b172-1e1d-4d4f-810c-1b08aea51074 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:10.525850 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea72b172-1e1d-4d4f-810c-1b08aea51074 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:10.526312 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea72b172-1e1d-4d4f-810c-1b08aea51074 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:10.677939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea72b172-1e1d-4d4f-810c-1b08aea51074 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:10.687236 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ea72b172-1e1d-4d4f-810c-1b08aea51074 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.176151 Oct 06 11:05:10.706473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 97/183] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:10 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:10.933580 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5981f505-fe58-46c1-af23-1beb0473e620 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:10.934186 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5981f505-fe58-46c1-af23-1beb0473e620 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:10.940893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5981f505-fe58-46c1-af23-1beb0473e620 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:10.941377 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5981f505-fe58-46c1-af23-1beb0473e620 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:10.941987 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5981f505-fe58-46c1-af23-1beb0473e620 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:10.942860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5981f505-fe58-46c1-af23-1beb0473e620 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:10.943492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5981f505-fe58-46c1-af23-1beb0473e620 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:10.944129 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5981f505-fe58-46c1-af23-1beb0473e620 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:11.018628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:11.019248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:11.025882 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:11.026790 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:11.027661 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:11.028671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:11.029417 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:11.029943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:11.092152 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5981f505-fe58-46c1-af23-1beb0473e620 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:11.101214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5981f505-fe58-46c1-af23-1beb0473e620 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.171243 Oct 06 11:05:11.101927 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 87/184] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:10 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:11.181575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:11.190315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:11.192027 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:11.193522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa73f56b-3e6a-485e-85d2-fb8f5574505d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.179615 Oct 06 11:05:11.194072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 98/185] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:11 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:11.469077 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2883c8be-5e21-4a1c-aa9e-d7c8b12b6881 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:11.470970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2883c8be-5e21-4a1c-aa9e-d7c8b12b6881 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:11.477625 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2883c8be-5e21-4a1c-aa9e-d7c8b12b6881 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:11.478157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2883c8be-5e21-4a1c-aa9e-d7c8b12b6881 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:11.478737 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2883c8be-5e21-4a1c-aa9e-d7c8b12b6881 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:11.479439 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2883c8be-5e21-4a1c-aa9e-d7c8b12b6881 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:11.479943 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2883c8be-5e21-4a1c-aa9e-d7c8b12b6881 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:11.480345 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2883c8be-5e21-4a1c-aa9e-d7c8b12b6881 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:11.647615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2883c8be-5e21-4a1c-aa9e-d7c8b12b6881 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:11.656064 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2883c8be-5e21-4a1c-aa9e-d7c8b12b6881 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.191102 Oct 06 11:05:11.657713 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 88/186] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:11 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:11.718874 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6468fd1-3e46-42a7-8d19-98d15f4186f2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:11.719520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a6468fd1-3e46-42a7-8d19-98d15f4186f2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:11.728084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6468fd1-3e46-42a7-8d19-98d15f4186f2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:11.728664 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6468fd1-3e46-42a7-8d19-98d15f4186f2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:11.729322 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6468fd1-3e46-42a7-8d19-98d15f4186f2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:11.730447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6468fd1-3e46-42a7-8d19-98d15f4186f2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:11.730971 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6468fd1-3e46-42a7-8d19-98d15f4186f2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:11.731390 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6468fd1-3e46-42a7-8d19-98d15f4186f2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:11.888552 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a6468fd1-3e46-42a7-8d19-98d15f4186f2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:11.900652 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6468fd1-3e46-42a7-8d19-98d15f4186f2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.189430 Oct 06 11:05:11.901582 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 99/187] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:11 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:12.125082 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab471756-ba50-4b1e-9cf6-821af33f2734 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:12.126293 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab471756-ba50-4b1e-9cf6-821af33f2734 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:12.135956 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab471756-ba50-4b1e-9cf6-821af33f2734 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:12.137060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab471756-ba50-4b1e-9cf6-821af33f2734 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:12.137605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab471756-ba50-4b1e-9cf6-821af33f2734 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:12.138734 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab471756-ba50-4b1e-9cf6-821af33f2734 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:12.139412 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab471756-ba50-4b1e-9cf6-821af33f2734 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:12.140101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab471756-ba50-4b1e-9cf6-821af33f2734 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:12.222819 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:12.223440 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:12.231771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:12.232640 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:12.233281 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:12.234768 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:12.234768 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:12.235682 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:12.381872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab471756-ba50-4b1e-9cf6-821af33f2734 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:12.390102 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab471756-ba50-4b1e-9cf6-821af33f2734 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.269307 Oct 06 11:05:12.390753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 89/188] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:12 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:12.406688 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:12.415378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:12.416890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:12.417986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c9bf0f2-c107-4744-a614-3c5463f6a897 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.199542 Oct 06 11:05:12.418583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 100/189] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:12 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:12.680486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-338f24e4-7e7e-4154-8cb9-b945bfb7b52a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:12.681332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-338f24e4-7e7e-4154-8cb9-b945bfb7b52a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:12.687052 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338f24e4-7e7e-4154-8cb9-b945bfb7b52a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:12.687535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338f24e4-7e7e-4154-8cb9-b945bfb7b52a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:12.687998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338f24e4-7e7e-4154-8cb9-b945bfb7b52a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:12.689213 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338f24e4-7e7e-4154-8cb9-b945bfb7b52a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:12.689655 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338f24e4-7e7e-4154-8cb9-b945bfb7b52a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:12.690106 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338f24e4-7e7e-4154-8cb9-b945bfb7b52a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:12.820180 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-338f24e4-7e7e-4154-8cb9-b945bfb7b52a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:12.827873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-338f24e4-7e7e-4154-8cb9-b945bfb7b52a tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.151190 Oct 06 11:05:12.828671 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 90/190] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:12 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:12.926727 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-068f692a-33c5-4194-8c12-b2446bd46646 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:12.927415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-068f692a-33c5-4194-8c12-b2446bd46646 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:12.935074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-068f692a-33c5-4194-8c12-b2446bd46646 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:12.935564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-068f692a-33c5-4194-8c12-b2446bd46646 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:12.936038 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-068f692a-33c5-4194-8c12-b2446bd46646 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:12.936740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-068f692a-33c5-4194-8c12-b2446bd46646 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:12.937196 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-068f692a-33c5-4194-8c12-b2446bd46646 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:12.937621 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-068f692a-33c5-4194-8c12-b2446bd46646 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:12.957619 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:13.095291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-068f692a-33c5-4194-8c12-b2446bd46646 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:13.104086 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-068f692a-33c5-4194-8c12-b2446bd46646 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.181226 Oct 06 11:05:13.104650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 101/191] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:12 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:13.414330 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c8d9fee-46cd-4763-b862-0efd7373d667 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:13.414950 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c8d9fee-46cd-4763-b862-0efd7373d667 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:13.420700 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c8d9fee-46cd-4763-b862-0efd7373d667 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:13.421185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c8d9fee-46cd-4763-b862-0efd7373d667 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:13.421623 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c8d9fee-46cd-4763-b862-0efd7373d667 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:13.422310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c8d9fee-46cd-4763-b862-0efd7373d667 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:13.422844 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c8d9fee-46cd-4763-b862-0efd7373d667 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:13.423276 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c8d9fee-46cd-4763-b862-0efd7373d667 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:13.445850 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:13.446881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:13.455057 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:13.455647 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:13.456343 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:13.457395 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:13.457849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:13.458272 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:13.587788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0c8d9fee-46cd-4763-b862-0efd7373d667 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:13.597923 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c8d9fee-46cd-4763-b862-0efd7373d667 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.187263 Oct 06 11:05:13.598784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 91/192] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:13 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:13.632594 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:13.640827 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:13.642886 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:13.644003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25ea9112-41ee-4f0f-996d-265cdf632fa5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.203582 Oct 06 11:05:13.644552 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 102/193] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:13 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:13.851101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-baac84af-90cf-4752-8445-50dd93bd5bfb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:13.851626 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-baac84af-90cf-4752-8445-50dd93bd5bfb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:13.857475 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baac84af-90cf-4752-8445-50dd93bd5bfb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:13.857950 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baac84af-90cf-4752-8445-50dd93bd5bfb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:13.858388 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baac84af-90cf-4752-8445-50dd93bd5bfb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:13.859063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baac84af-90cf-4752-8445-50dd93bd5bfb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:13.859505 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baac84af-90cf-4752-8445-50dd93bd5bfb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:13.859953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baac84af-90cf-4752-8445-50dd93bd5bfb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:13.983801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-baac84af-90cf-4752-8445-50dd93bd5bfb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:13.991531 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-baac84af-90cf-4752-8445-50dd93bd5bfb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.144330 Oct 06 11:05:13.992126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 92/194] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:13 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:14.126765 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dd614b3f-e553-43d7-9f31-f6c95feb4c35 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:14.127356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dd614b3f-e553-43d7-9f31-f6c95feb4c35 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:14.133344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd614b3f-e553-43d7-9f31-f6c95feb4c35 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:14.133815 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd614b3f-e553-43d7-9f31-f6c95feb4c35 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:14.134248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd614b3f-e553-43d7-9f31-f6c95feb4c35 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:14.134922 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd614b3f-e553-43d7-9f31-f6c95feb4c35 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:14.135369 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd614b3f-e553-43d7-9f31-f6c95feb4c35 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:14.135784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd614b3f-e553-43d7-9f31-f6c95feb4c35 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:14.264585 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-dd614b3f-e553-43d7-9f31-f6c95feb4c35 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:14.273104 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dd614b3f-e553-43d7-9f31-f6c95feb4c35 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.150777 Oct 06 11:05:14.273788 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 103/195] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:14 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:14.621586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-acfe6a23-febb-401a-972d-55e4b1e3a058 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:14.622222 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-acfe6a23-febb-401a-972d-55e4b1e3a058 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:14.628488 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acfe6a23-febb-401a-972d-55e4b1e3a058 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:14.628976 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acfe6a23-febb-401a-972d-55e4b1e3a058 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:14.629412 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acfe6a23-febb-401a-972d-55e4b1e3a058 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:14.630102 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acfe6a23-febb-401a-972d-55e4b1e3a058 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:14.630553 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acfe6a23-febb-401a-972d-55e4b1e3a058 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:14.631008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acfe6a23-febb-401a-972d-55e4b1e3a058 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:14.672011 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:14.672897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:14.679090 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:14.679571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:14.680041 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:14.680729 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:14.681174 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:14.681591 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:14.762125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-acfe6a23-febb-401a-972d-55e4b1e3a058 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:14.770779 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-acfe6a23-febb-401a-972d-55e4b1e3a058 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.152939 Oct 06 11:05:14.771357 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 93/196] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:14 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:14.814895 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:14.822798 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:14.824271 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:14.825355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a33fcd7b-32c2-4044-b28a-8f9bcf92cc8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.157700 Oct 06 11:05:14.825901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 104/197] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:14 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:15.013889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77fefbb8-4259-4b02-aac6-291ab98a39b9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:15.014424 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77fefbb8-4259-4b02-aac6-291ab98a39b9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:15.022851 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77fefbb8-4259-4b02-aac6-291ab98a39b9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:15.023336 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77fefbb8-4259-4b02-aac6-291ab98a39b9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:15.023763 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77fefbb8-4259-4b02-aac6-291ab98a39b9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:15.024484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77fefbb8-4259-4b02-aac6-291ab98a39b9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:15.024926 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77fefbb8-4259-4b02-aac6-291ab98a39b9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:15.025341 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77fefbb8-4259-4b02-aac6-291ab98a39b9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:15.155326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-77fefbb8-4259-4b02-aac6-291ab98a39b9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:15.162879 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77fefbb8-4259-4b02-aac6-291ab98a39b9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.152873 Oct 06 11:05:15.163432 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 94/198] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:15 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:15.295894 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-245fd386-ac25-4d4b-8493-1ff4be46a9ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:15.296416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-245fd386-ac25-4d4b-8493-1ff4be46a9ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:15.302431 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-245fd386-ac25-4d4b-8493-1ff4be46a9ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:15.302906 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-245fd386-ac25-4d4b-8493-1ff4be46a9ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:15.303342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-245fd386-ac25-4d4b-8493-1ff4be46a9ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:15.304060 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-245fd386-ac25-4d4b-8493-1ff4be46a9ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:15.304512 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-245fd386-ac25-4d4b-8493-1ff4be46a9ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:15.304932 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-245fd386-ac25-4d4b-8493-1ff4be46a9ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:15.432854 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-245fd386-ac25-4d4b-8493-1ff4be46a9ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:15.441351 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-245fd386-ac25-4d4b-8493-1ff4be46a9ca tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.149302 Oct 06 11:05:15.441920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 105/199] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:15 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:15.793546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eff4d404-8692-4318-9d80-63d227b8521e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:15.794158 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eff4d404-8692-4318-9d80-63d227b8521e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:15.800752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff4d404-8692-4318-9d80-63d227b8521e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:15.801164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff4d404-8692-4318-9d80-63d227b8521e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:15.801598 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff4d404-8692-4318-9d80-63d227b8521e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:15.802279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff4d404-8692-4318-9d80-63d227b8521e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:15.802729 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff4d404-8692-4318-9d80-63d227b8521e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:15.803151 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff4d404-8692-4318-9d80-63d227b8521e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:15.851286 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:15.851992 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:15.858229 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:15.859104 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:15.859762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:15.861438 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:15.862070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:15.862503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:15.932680 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eff4d404-8692-4318-9d80-63d227b8521e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:15.940612 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eff4d404-8692-4318-9d80-63d227b8521e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.150989 Oct 06 11:05:15.946279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 95/200] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:15 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:15.990688 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:15.998645 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:16.000109 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:16.001345 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1b404d7-1352-469b-8724-fd06a3e016c2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.153882 Oct 06 11:05:16.001893 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 106/201] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:15 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:16.185287 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3f40754b-b567-4abd-9b48-0146c2cc8899 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:16.185900 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3f40754b-b567-4abd-9b48-0146c2cc8899 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:16.192085 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40754b-b567-4abd-9b48-0146c2cc8899 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:16.192574 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40754b-b567-4abd-9b48-0146c2cc8899 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:16.193015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40754b-b567-4abd-9b48-0146c2cc8899 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:16.193707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40754b-b567-4abd-9b48-0146c2cc8899 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:16.194200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40754b-b567-4abd-9b48-0146c2cc8899 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:16.194628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40754b-b567-4abd-9b48-0146c2cc8899 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:16.324025 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3f40754b-b567-4abd-9b48-0146c2cc8899 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:16.332285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3f40754b-b567-4abd-9b48-0146c2cc8899 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.150804 Oct 06 11:05:16.332847 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 96/202] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:16 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:16.462965 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5ccc6657-757f-40e5-ab77-1020116442cc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:16.463660 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5ccc6657-757f-40e5-ab77-1020116442cc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:16.470210 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ccc6657-757f-40e5-ab77-1020116442cc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:16.470960 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ccc6657-757f-40e5-ab77-1020116442cc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:16.471673 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ccc6657-757f-40e5-ab77-1020116442cc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:16.473061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ccc6657-757f-40e5-ab77-1020116442cc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:16.473061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ccc6657-757f-40e5-ab77-1020116442cc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:16.473430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ccc6657-757f-40e5-ab77-1020116442cc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:16.613074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5ccc6657-757f-40e5-ab77-1020116442cc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:16.620522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5ccc6657-757f-40e5-ab77-1020116442cc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.161433 Oct 06 11:05:16.621076 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 107/203] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:16 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:16.964213 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a54d9858-1ce2-4588-a6fe-e9008a12cd5d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:16.964771 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a54d9858-1ce2-4588-a6fe-e9008a12cd5d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:16.971762 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a54d9858-1ce2-4588-a6fe-e9008a12cd5d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:16.972277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a54d9858-1ce2-4588-a6fe-e9008a12cd5d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:16.972716 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a54d9858-1ce2-4588-a6fe-e9008a12cd5d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:16.973400 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a54d9858-1ce2-4588-a6fe-e9008a12cd5d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:16.973860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a54d9858-1ce2-4588-a6fe-e9008a12cd5d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:16.974283 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a54d9858-1ce2-4588-a6fe-e9008a12cd5d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:17.027216 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:17.027984 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:17.034747 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:17.035300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:17.035800 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:17.036518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:17.036964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:17.037385 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:17.127936 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a54d9858-1ce2-4588-a6fe-e9008a12cd5d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:17.136384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a54d9858-1ce2-4588-a6fe-e9008a12cd5d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.176061 Oct 06 11:05:17.136955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 97/204] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:16 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:17.187541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:17.196547 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:17.197752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:17.198844 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d94eb0f-8ee5-4cb3-929c-b23977d1181d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.175534 Oct 06 11:05:17.199447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 108/205] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:17 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:17.355063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7879cd5-b045-4ac1-8f81-f84040377ddd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:17.355685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7879cd5-b045-4ac1-8f81-f84040377ddd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:17.370499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7879cd5-b045-4ac1-8f81-f84040377ddd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:17.370995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7879cd5-b045-4ac1-8f81-f84040377ddd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:17.371428 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7879cd5-b045-4ac1-8f81-f84040377ddd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:17.372277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7879cd5-b045-4ac1-8f81-f84040377ddd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:17.372736 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7879cd5-b045-4ac1-8f81-f84040377ddd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:17.373195 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7879cd5-b045-4ac1-8f81-f84040377ddd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:17.396193 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:17.645397 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1f0e16b-b9b4-498a-96fb-5003eaa392af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:17.646139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1f0e16b-b9b4-498a-96fb-5003eaa392af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:17.652881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f0e16b-b9b4-498a-96fb-5003eaa392af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:17.653596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f0e16b-b9b4-498a-96fb-5003eaa392af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:17.654035 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f0e16b-b9b4-498a-96fb-5003eaa392af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:17.680165 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f0e16b-b9b4-498a-96fb-5003eaa392af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:17.683260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f0e16b-b9b4-498a-96fb-5003eaa392af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:17.684138 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f0e16b-b9b4-498a-96fb-5003eaa392af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:18.050854 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7879cd5-b045-4ac1-8f81-f84040377ddd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:18.069152 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7879cd5-b045-4ac1-8f81-f84040377ddd tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.717752 Oct 06 11:05:18.070118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 98/206] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:17 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:18.161256 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6be07673-8ad5-4fc6-809f-ac18cdc5c5dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:18.162261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6be07673-8ad5-4fc6-809f-ac18cdc5c5dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:18.195725 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6be07673-8ad5-4fc6-809f-ac18cdc5c5dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:18.196455 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6be07673-8ad5-4fc6-809f-ac18cdc5c5dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:18.198102 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6be07673-8ad5-4fc6-809f-ac18cdc5c5dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:18.200570 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6be07673-8ad5-4fc6-809f-ac18cdc5c5dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:18.201702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6be07673-8ad5-4fc6-809f-ac18cdc5c5dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:18.202701 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6be07673-8ad5-4fc6-809f-ac18cdc5c5dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:18.411259 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6be07673-8ad5-4fc6-809f-ac18cdc5c5dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:18.421989 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6be07673-8ad5-4fc6-809f-ac18cdc5c5dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.264766 Oct 06 11:05:18.437614 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 99/207] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:18 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:18.442449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:18.443485 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:18.453374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:18.455098 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:18.456607 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:18.457490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:18.458100 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:18.458876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:18.477772 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1f0e16b-b9b4-498a-96fb-5003eaa392af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:18.491231 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1f0e16b-b9b4-498a-96fb-5003eaa392af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.851331 Oct 06 11:05:18.508666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 109/208] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:17 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:18.765554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:18.782808 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:18.788865 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:18.791008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e573d80-8bd2-499e-87a5-9faed195a751 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.354138 Oct 06 11:05:18.792470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 100/209] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:18 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:19.072193 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-48c105e0-00ef-468b-828b-8e7d8d2287a3 req-f2f22375-cc09-4873-b272-4f73db9d60eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de15d8c-124c-4827-839a-89d209f344e8", "name": "network-vif-plugged", "status": "completed", "tag": "3dad21ae-1cb8-4cb8-b40b-12d49df819af"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:05:19.083883 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-48c105e0-00ef-468b-828b-8e7d8d2287a3 req-f2f22375-cc09-4873-b272-4f73db9d60eb service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:19.084799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-48c105e0-00ef-468b-828b-8e7d8d2287a3 req-f2f22375-cc09-4873-b272-4f73db9d60eb service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:19.085651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-48c105e0-00ef-468b-828b-8e7d8d2287a3 req-f2f22375-cc09-4873-b272-4f73db9d60eb service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:19.099014 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29c37e05-95c8-4058-b3ac-1ba83303e14f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:19.099814 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29c37e05-95c8-4058-b3ac-1ba83303e14f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:19.107729 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29c37e05-95c8-4058-b3ac-1ba83303e14f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:19.108252 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29c37e05-95c8-4058-b3ac-1ba83303e14f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:19.108880 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29c37e05-95c8-4058-b3ac-1ba83303e14f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:19.109747 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29c37e05-95c8-4058-b3ac-1ba83303e14f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:19.110776 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29c37e05-95c8-4058-b3ac-1ba83303e14f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:19.111363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29c37e05-95c8-4058-b3ac-1ba83303e14f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:19.125320 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-48c105e0-00ef-468b-828b-8e7d8d2287a3 req-f2f22375-cc09-4873-b272-4f73db9d60eb service nova] Creating event network-vif-plugged:3dad21ae-1cb8-4cb8-b40b-12d49df819af for instance 9de15d8c-124c-4827-839a-89d209f344e8 on hv-cinder-86020 Oct 06 11:05:19.135445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-48c105e0-00ef-468b-828b-8e7d8d2287a3 req-f2f22375-cc09-4873-b272-4f73db9d60eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068632 Oct 06 11:05:19.137830 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 110/210] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:05:19.285364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29c37e05-95c8-4058-b3ac-1ba83303e14f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:19.296081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29c37e05-95c8-4058-b3ac-1ba83303e14f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.200915 Oct 06 11:05:19.297179 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 101/211] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:19 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:19.445912 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-014ebca0-961e-4881-ae05-0ff638a32fbc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:19.446601 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-014ebca0-961e-4881-ae05-0ff638a32fbc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:19.453235 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014ebca0-961e-4881-ae05-0ff638a32fbc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:19.453764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014ebca0-961e-4881-ae05-0ff638a32fbc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:19.454726 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014ebca0-961e-4881-ae05-0ff638a32fbc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:19.455423 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014ebca0-961e-4881-ae05-0ff638a32fbc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:19.456050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014ebca0-961e-4881-ae05-0ff638a32fbc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:19.456483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014ebca0-961e-4881-ae05-0ff638a32fbc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:19.538153 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d33aaa00-ce3c-49ab-b513-a081db13f015 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:19.538900 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d33aaa00-ce3c-49ab-b513-a081db13f015 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:19.546122 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d33aaa00-ce3c-49ab-b513-a081db13f015 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:19.546686 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d33aaa00-ce3c-49ab-b513-a081db13f015 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:19.547229 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d33aaa00-ce3c-49ab-b513-a081db13f015 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:19.548211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d33aaa00-ce3c-49ab-b513-a081db13f015 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:19.548790 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d33aaa00-ce3c-49ab-b513-a081db13f015 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:19.549320 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d33aaa00-ce3c-49ab-b513-a081db13f015 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:19.609269 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-014ebca0-961e-4881-ae05-0ff638a32fbc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:19.617215 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-014ebca0-961e-4881-ae05-0ff638a32fbc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.175464 Oct 06 11:05:19.617800 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 111/212] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:19 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:19.722301 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d33aaa00-ce3c-49ab-b513-a081db13f015 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:19.730507 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d33aaa00-ce3c-49ab-b513-a081db13f015 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.198578 Oct 06 11:05:19.744253 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 102/213] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:19 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:19.819047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:19.819667 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:19.825764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:19.826252 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:19.826689 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:19.827375 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:19.827823 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:19.828268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:19.964720 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:19.973320 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:19.974804 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:19.976596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-07f8a488-c67b-489c-87f7-38b944ead87c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.161232 Oct 06 11:05:19.977243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 112/214] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:19 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:20.320258 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d0cdd35-8830-4c86-8fc7-cc8901d41235 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:20.320865 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d0cdd35-8830-4c86-8fc7-cc8901d41235 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:20.329616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d0cdd35-8830-4c86-8fc7-cc8901d41235 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:20.330280 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d0cdd35-8830-4c86-8fc7-cc8901d41235 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:20.330671 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d0cdd35-8830-4c86-8fc7-cc8901d41235 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:20.331555 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d0cdd35-8830-4c86-8fc7-cc8901d41235 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:20.332330 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d0cdd35-8830-4c86-8fc7-cc8901d41235 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:20.332759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d0cdd35-8830-4c86-8fc7-cc8901d41235 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:20.501601 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5d0cdd35-8830-4c86-8fc7-cc8901d41235 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:20.510964 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d0cdd35-8830-4c86-8fc7-cc8901d41235 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.193249 Oct 06 11:05:20.511797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 103/215] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:20 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:20.643113 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a50803a7-2c43-432a-9075-eaeb4d07aa51 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:20.643871 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a50803a7-2c43-432a-9075-eaeb4d07aa51 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:20.650450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a50803a7-2c43-432a-9075-eaeb4d07aa51 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:20.650935 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a50803a7-2c43-432a-9075-eaeb4d07aa51 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:20.651369 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a50803a7-2c43-432a-9075-eaeb4d07aa51 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:20.652224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a50803a7-2c43-432a-9075-eaeb4d07aa51 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:20.652573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a50803a7-2c43-432a-9075-eaeb4d07aa51 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:20.653122 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a50803a7-2c43-432a-9075-eaeb4d07aa51 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:20.761313 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83980b33-2423-4caf-a5fb-b8d730e1c78e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:20.762608 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83980b33-2423-4caf-a5fb-b8d730e1c78e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:20.776326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83980b33-2423-4caf-a5fb-b8d730e1c78e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:20.777314 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83980b33-2423-4caf-a5fb-b8d730e1c78e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:20.778211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83980b33-2423-4caf-a5fb-b8d730e1c78e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:20.780647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83980b33-2423-4caf-a5fb-b8d730e1c78e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:20.785533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83980b33-2423-4caf-a5fb-b8d730e1c78e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:20.786436 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83980b33-2423-4caf-a5fb-b8d730e1c78e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:20.822784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a50803a7-2c43-432a-9075-eaeb4d07aa51 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:20.836402 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a50803a7-2c43-432a-9075-eaeb4d07aa51 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.200239 Oct 06 11:05:20.837779 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 113/216] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:20 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:20.945216 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-83980b33-2423-4caf-a5fb-b8d730e1c78e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:20.954436 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83980b33-2423-4caf-a5fb-b8d730e1c78e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.203621 Oct 06 11:05:20.955444 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 104/217] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:20 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:21.002773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:21.003377 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:21.009705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:21.010279 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:21.010716 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:21.011404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:21.011865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:21.012287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:21.166363 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:21.175448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:21.176940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:21.178146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7fffd058-e013-40ec-a11d-dbeb420fc844 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.179358 Oct 06 11:05:21.178702 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 114/218] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:20 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:21.535407 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bbdf2c25-1725-4de2-a1d5-f9ce15b2af01 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:21.536142 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bbdf2c25-1725-4de2-a1d5-f9ce15b2af01 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:21.542187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbdf2c25-1725-4de2-a1d5-f9ce15b2af01 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:21.542744 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbdf2c25-1725-4de2-a1d5-f9ce15b2af01 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:21.543195 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbdf2c25-1725-4de2-a1d5-f9ce15b2af01 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:21.543890 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbdf2c25-1725-4de2-a1d5-f9ce15b2af01 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:21.544341 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbdf2c25-1725-4de2-a1d5-f9ce15b2af01 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:21.544758 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbdf2c25-1725-4de2-a1d5-f9ce15b2af01 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:21.681019 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bbdf2c25-1725-4de2-a1d5-f9ce15b2af01 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:21.692579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bbdf2c25-1725-4de2-a1d5-f9ce15b2af01 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.161792 Oct 06 11:05:21.693060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 105/219] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:21 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:21.862010 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba82c2c5-d4fc-4116-8658-79cda540f8f9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:21.862840 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba82c2c5-d4fc-4116-8658-79cda540f8f9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:21.869205 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba82c2c5-d4fc-4116-8658-79cda540f8f9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:21.869914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba82c2c5-d4fc-4116-8658-79cda540f8f9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:21.870526 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba82c2c5-d4fc-4116-8658-79cda540f8f9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:21.871238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba82c2c5-d4fc-4116-8658-79cda540f8f9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:21.871700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba82c2c5-d4fc-4116-8658-79cda540f8f9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:21.872163 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba82c2c5-d4fc-4116-8658-79cda540f8f9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:21.979752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0d8c61f-6a36-43c7-b5ca-f39b2b9d7606 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:21.981036 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0d8c61f-6a36-43c7-b5ca-f39b2b9d7606 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:21.988554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d8c61f-6a36-43c7-b5ca-f39b2b9d7606 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:21.989355 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d8c61f-6a36-43c7-b5ca-f39b2b9d7606 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:21.989946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d8c61f-6a36-43c7-b5ca-f39b2b9d7606 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:21.990883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d8c61f-6a36-43c7-b5ca-f39b2b9d7606 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:21.991498 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d8c61f-6a36-43c7-b5ca-f39b2b9d7606 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:21.992658 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d8c61f-6a36-43c7-b5ca-f39b2b9d7606 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:22.011318 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba82c2c5-d4fc-4116-8658-79cda540f8f9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:22.020213 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba82c2c5-d4fc-4116-8658-79cda540f8f9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.162309 Oct 06 11:05:22.023320 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 115/220] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:21 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:22.139247 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0d8c61f-6a36-43c7-b5ca-f39b2b9d7606 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:22.147923 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0d8c61f-6a36-43c7-b5ca-f39b2b9d7606 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.171712 Oct 06 11:05:22.148570 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 106/221] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:21 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:22.203644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:22.204376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:22.210513 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:22.211051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:22.211563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:22.212281 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:22.212867 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:22.213327 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:22.375466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:22.386053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:22.387796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:22.389137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a11181c8-ed45-4bd3-af76-620f500b3f8a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.190171 Oct 06 11:05:22.389693 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 116/222] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:22 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:22.715629 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd0b51ad-7d22-4147-8a6e-40ba8dc51b33 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:22.716275 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd0b51ad-7d22-4147-8a6e-40ba8dc51b33 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:22.722131 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0b51ad-7d22-4147-8a6e-40ba8dc51b33 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:22.722610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0b51ad-7d22-4147-8a6e-40ba8dc51b33 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:22.723046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0b51ad-7d22-4147-8a6e-40ba8dc51b33 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:22.723727 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0b51ad-7d22-4147-8a6e-40ba8dc51b33 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:22.724210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0b51ad-7d22-4147-8a6e-40ba8dc51b33 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:22.724635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd0b51ad-7d22-4147-8a6e-40ba8dc51b33 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:22.853060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd0b51ad-7d22-4147-8a6e-40ba8dc51b33 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:22.861150 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd0b51ad-7d22-4147-8a6e-40ba8dc51b33 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.149367 Oct 06 11:05:22.861715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 107/223] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:22 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:23.046293 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86984695-2cfe-4b7e-b247-3c039a2df8bb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:23.046907 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86984695-2cfe-4b7e-b247-3c039a2df8bb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:23.053953 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86984695-2cfe-4b7e-b247-3c039a2df8bb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:23.054377 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86984695-2cfe-4b7e-b247-3c039a2df8bb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:23.054813 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86984695-2cfe-4b7e-b247-3c039a2df8bb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:23.055530 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86984695-2cfe-4b7e-b247-3c039a2df8bb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:23.056026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86984695-2cfe-4b7e-b247-3c039a2df8bb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:23.056492 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86984695-2cfe-4b7e-b247-3c039a2df8bb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:23.175767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8060f76c-393f-426b-9ca3-f28412903186 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:23.178258 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8060f76c-393f-426b-9ca3-f28412903186 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:23.191005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8060f76c-393f-426b-9ca3-f28412903186 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:23.192139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8060f76c-393f-426b-9ca3-f28412903186 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:23.193399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8060f76c-393f-426b-9ca3-f28412903186 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:23.194724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-86984695-2cfe-4b7e-b247-3c039a2df8bb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:23.194881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8060f76c-393f-426b-9ca3-f28412903186 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:23.195525 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8060f76c-393f-426b-9ca3-f28412903186 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:23.197069 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8060f76c-393f-426b-9ca3-f28412903186 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:23.210763 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86984695-2cfe-4b7e-b247-3c039a2df8bb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.168340 Oct 06 11:05:23.211684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 117/224] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:23 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:23.415002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:23.415763 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8060f76c-393f-426b-9ca3-f28412903186 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:23.416303 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:23.424686 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:23.425497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:23.426805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:23.427545 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8060f76c-393f-426b-9ca3-f28412903186 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.260453 Oct 06 11:05:23.428218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:23.439872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 108/225] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:23 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:23.441672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:23.442445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:23.596681 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:23.600470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:23.606263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:23.607920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:23.609168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cd33a497-cad7-49c7-ac77-c57d9447b777 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.198573 Oct 06 11:05:23.609717 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 118/226] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:23 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:23.884441 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95a3eb1c-4be9-42ab-a339-3b2ce7510061 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:23.884961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-95a3eb1c-4be9-42ab-a339-3b2ce7510061 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:23.890813 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95a3eb1c-4be9-42ab-a339-3b2ce7510061 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:23.892231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95a3eb1c-4be9-42ab-a339-3b2ce7510061 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:23.892430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95a3eb1c-4be9-42ab-a339-3b2ce7510061 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:23.893079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95a3eb1c-4be9-42ab-a339-3b2ce7510061 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:23.893526 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95a3eb1c-4be9-42ab-a339-3b2ce7510061 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:23.893945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95a3eb1c-4be9-42ab-a339-3b2ce7510061 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:24.023348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-95a3eb1c-4be9-42ab-a339-3b2ce7510061 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:24.030919 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95a3eb1c-4be9-42ab-a339-3b2ce7510061 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.150396 Oct 06 11:05:24.031483 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 109/227] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:23 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:24.234644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25ffcd31-b83b-4a34-8d2b-0232ec6a398e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:24.235258 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25ffcd31-b83b-4a34-8d2b-0232ec6a398e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:24.241060 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ffcd31-b83b-4a34-8d2b-0232ec6a398e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:24.241539 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ffcd31-b83b-4a34-8d2b-0232ec6a398e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:24.241965 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ffcd31-b83b-4a34-8d2b-0232ec6a398e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:24.242644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ffcd31-b83b-4a34-8d2b-0232ec6a398e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:24.243091 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ffcd31-b83b-4a34-8d2b-0232ec6a398e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:24.243504 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25ffcd31-b83b-4a34-8d2b-0232ec6a398e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:24.378486 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-25ffcd31-b83b-4a34-8d2b-0232ec6a398e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:24.386026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25ffcd31-b83b-4a34-8d2b-0232ec6a398e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.155287 Oct 06 11:05:24.386590 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 119/228] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:24 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:24.455292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e614ce0c-1d6b-433d-b81b-eef2ea32e286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:24.455927 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e614ce0c-1d6b-433d-b81b-eef2ea32e286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:24.461789 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614ce0c-1d6b-433d-b81b-eef2ea32e286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:24.462266 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614ce0c-1d6b-433d-b81b-eef2ea32e286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:24.462750 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614ce0c-1d6b-433d-b81b-eef2ea32e286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:24.463381 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614ce0c-1d6b-433d-b81b-eef2ea32e286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:24.463831 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614ce0c-1d6b-433d-b81b-eef2ea32e286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:24.464279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614ce0c-1d6b-433d-b81b-eef2ea32e286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:24.597745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e614ce0c-1d6b-433d-b81b-eef2ea32e286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:24.607209 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e614ce0c-1d6b-433d-b81b-eef2ea32e286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.156162 Oct 06 11:05:24.619861 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 110/229] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:24 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:24.633808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:24.634417 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:24.640226 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:24.640712 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:24.641155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:24.642409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:24.642863 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:24.643288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:24.797803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:24.807531 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:24.809439 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:24.810642 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cabbb843-0b28-481e-a0aa-88a4d3021543 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.180713 Oct 06 11:05:24.811512 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 120/230] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:24 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:24.838284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c2d64e62-d057-48db-b9c8-95a4e0bb6c62 req-a481a063-a14b-4196-9262-7ff7cde9e0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9864b6-cb13-4dc0-97d2-e155a1717ec9", "name": "network-vif-plugged", "status": "completed", "tag": "50343d2f-ca78-433a-93c4-aaa96d6e2a26"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:05:24.849101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c2d64e62-d057-48db-b9c8-95a4e0bb6c62 req-a481a063-a14b-4196-9262-7ff7cde9e0d4 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:24.849607 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c2d64e62-d057-48db-b9c8-95a4e0bb6c62 req-a481a063-a14b-4196-9262-7ff7cde9e0d4 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:24.850175 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c2d64e62-d057-48db-b9c8-95a4e0bb6c62 req-a481a063-a14b-4196-9262-7ff7cde9e0d4 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:24.863634 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c2d64e62-d057-48db-b9c8-95a4e0bb6c62 req-a481a063-a14b-4196-9262-7ff7cde9e0d4 service nova] Creating event network-vif-plugged:50343d2f-ca78-433a-93c4-aaa96d6e2a26 for instance ec9864b6-cb13-4dc0-97d2-e155a1717ec9 on hv-cinder-86020 Oct 06 11:05:24.871948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c2d64e62-d057-48db-b9c8-95a4e0bb6c62 req-a481a063-a14b-4196-9262-7ff7cde9e0d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034823 Oct 06 11:05:24.874945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 111/231] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:05:25.054297 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b628d3c8-eba0-4c13-87de-cca8ff8495f4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:25.054911 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b628d3c8-eba0-4c13-87de-cca8ff8495f4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:25.060753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b628d3c8-eba0-4c13-87de-cca8ff8495f4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:25.061235 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b628d3c8-eba0-4c13-87de-cca8ff8495f4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:25.061676 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b628d3c8-eba0-4c13-87de-cca8ff8495f4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:25.062553 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b628d3c8-eba0-4c13-87de-cca8ff8495f4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:25.062806 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b628d3c8-eba0-4c13-87de-cca8ff8495f4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:25.063909 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b628d3c8-eba0-4c13-87de-cca8ff8495f4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:25.196171 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b628d3c8-eba0-4c13-87de-cca8ff8495f4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:25.203914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b628d3c8-eba0-4c13-87de-cca8ff8495f4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.153459 Oct 06 11:05:25.204571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 121/232] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:25 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:25.411130 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad7f5775-613e-4712-837a-3cfd7b3a197d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:25.411830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad7f5775-613e-4712-837a-3cfd7b3a197d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:25.417993 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad7f5775-613e-4712-837a-3cfd7b3a197d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:25.418480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad7f5775-613e-4712-837a-3cfd7b3a197d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:25.418962 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad7f5775-613e-4712-837a-3cfd7b3a197d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:25.419661 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad7f5775-613e-4712-837a-3cfd7b3a197d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:25.420150 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad7f5775-613e-4712-837a-3cfd7b3a197d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:25.420579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad7f5775-613e-4712-837a-3cfd7b3a197d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:25.550745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ad7f5775-613e-4712-837a-3cfd7b3a197d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:25.571294 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad7f5775-613e-4712-837a-3cfd7b3a197d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.164733 Oct 06 11:05:25.572070 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 112/233] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:25 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:25.631367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6e5a094c-7d15-4845-ab18-cae89fda3a0f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:25.632541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6e5a094c-7d15-4845-ab18-cae89fda3a0f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:25.639266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e5a094c-7d15-4845-ab18-cae89fda3a0f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:25.639978 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e5a094c-7d15-4845-ab18-cae89fda3a0f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:25.640742 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e5a094c-7d15-4845-ab18-cae89fda3a0f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:25.641878 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e5a094c-7d15-4845-ab18-cae89fda3a0f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:25.642488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e5a094c-7d15-4845-ab18-cae89fda3a0f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:25.643208 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e5a094c-7d15-4845-ab18-cae89fda3a0f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:25.787990 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6e5a094c-7d15-4845-ab18-cae89fda3a0f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:25.795725 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6e5a094c-7d15-4845-ab18-cae89fda3a0f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.168871 Oct 06 11:05:25.796342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 122/234] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:25 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:25.837332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:25.837943 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:25.843753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:25.844336 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:25.845325 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:25.846031 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:25.846479 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:25.846906 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:25.971711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:25.979624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:25.981091 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:25.982172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77d7d3cf-42c1-403c-a18e-42389e3de64c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.148692 Oct 06 11:05:25.982717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 113/235] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:25 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:26.226719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b275ddd-497d-4982-8498-e2083939a430 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:26.227333 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0b275ddd-497d-4982-8498-e2083939a430 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:26.233273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b275ddd-497d-4982-8498-e2083939a430 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:26.233756 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b275ddd-497d-4982-8498-e2083939a430 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:26.234191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b275ddd-497d-4982-8498-e2083939a430 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:26.234894 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b275ddd-497d-4982-8498-e2083939a430 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:26.235580 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b275ddd-497d-4982-8498-e2083939a430 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:26.236037 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b275ddd-497d-4982-8498-e2083939a430 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:26.363961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0b275ddd-497d-4982-8498-e2083939a430 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:26.371557 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0b275ddd-497d-4982-8498-e2083939a430 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.148736 Oct 06 11:05:26.372143 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 123/236] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:26 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:26.595373 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a5914b6-19fb-4142-8457-dc7ee5abd7d1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:26.595918 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a5914b6-19fb-4142-8457-dc7ee5abd7d1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:26.601793 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5914b6-19fb-4142-8457-dc7ee5abd7d1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:26.602277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5914b6-19fb-4142-8457-dc7ee5abd7d1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:26.602709 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5914b6-19fb-4142-8457-dc7ee5abd7d1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:26.603392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5914b6-19fb-4142-8457-dc7ee5abd7d1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:26.603858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5914b6-19fb-4142-8457-dc7ee5abd7d1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:26.604290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5914b6-19fb-4142-8457-dc7ee5abd7d1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:26.732205 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4a5914b6-19fb-4142-8457-dc7ee5abd7d1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:26.740350 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a5914b6-19fb-4142-8457-dc7ee5abd7d1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.148930 Oct 06 11:05:26.740909 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 114/237] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:26 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:26.819063 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6bed70c3-8baa-47a3-8cb5-602dd290a88c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:26.819675 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6bed70c3-8baa-47a3-8cb5-602dd290a88c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:26.825567 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bed70c3-8baa-47a3-8cb5-602dd290a88c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:26.826053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bed70c3-8baa-47a3-8cb5-602dd290a88c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:26.826488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bed70c3-8baa-47a3-8cb5-602dd290a88c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:26.827178 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bed70c3-8baa-47a3-8cb5-602dd290a88c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:26.827630 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bed70c3-8baa-47a3-8cb5-602dd290a88c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:26.828091 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bed70c3-8baa-47a3-8cb5-602dd290a88c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:26.954445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6bed70c3-8baa-47a3-8cb5-602dd290a88c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:26.961946 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6bed70c3-8baa-47a3-8cb5-602dd290a88c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.146741 Oct 06 11:05:26.962511 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 124/238] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:26 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:27.007454 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:27.008089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:27.013916 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:27.014403 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:27.014825 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:27.015504 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:27.015980 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:27.016632 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:27.147909 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:27.151349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:27.157314 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:27.159048 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:27.160178 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8dcab643-f258-48e9-be24-ca7ef2ed6126 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.156689 Oct 06 11:05:27.160730 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 115/239] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:27 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:27.394755 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9396fcdb-6a89-48fb-b461-c02a0e4dd40d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:27.395360 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9396fcdb-6a89-48fb-b461-c02a0e4dd40d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:27.401503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9396fcdb-6a89-48fb-b461-c02a0e4dd40d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:27.401986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9396fcdb-6a89-48fb-b461-c02a0e4dd40d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:27.402416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9396fcdb-6a89-48fb-b461-c02a0e4dd40d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:27.403099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9396fcdb-6a89-48fb-b461-c02a0e4dd40d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:27.403540 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9396fcdb-6a89-48fb-b461-c02a0e4dd40d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:27.403992 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9396fcdb-6a89-48fb-b461-c02a0e4dd40d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:27.533700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9396fcdb-6a89-48fb-b461-c02a0e4dd40d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:27.541182 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9396fcdb-6a89-48fb-b461-c02a0e4dd40d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.150686 Oct 06 11:05:27.541740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 125/240] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:27 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:27.763431 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-336eae6b-7874-4214-b4fd-1b6cb78cd29e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:27.764091 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-336eae6b-7874-4214-b4fd-1b6cb78cd29e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:27.770689 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-336eae6b-7874-4214-b4fd-1b6cb78cd29e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:27.771165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-336eae6b-7874-4214-b4fd-1b6cb78cd29e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:27.771593 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-336eae6b-7874-4214-b4fd-1b6cb78cd29e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:27.772571 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-336eae6b-7874-4214-b4fd-1b6cb78cd29e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:27.773023 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-336eae6b-7874-4214-b4fd-1b6cb78cd29e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:27.773439 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-336eae6b-7874-4214-b4fd-1b6cb78cd29e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:27.899536 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-336eae6b-7874-4214-b4fd-1b6cb78cd29e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:27.907047 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-336eae6b-7874-4214-b4fd-1b6cb78cd29e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.147492 Oct 06 11:05:27.907604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 116/241] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:27 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:27.985623 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e34638b-46a5-4d75-8c44-0fe6981ae38c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:27.986462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e34638b-46a5-4d75-8c44-0fe6981ae38c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:27.992416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e34638b-46a5-4d75-8c44-0fe6981ae38c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:27.992897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e34638b-46a5-4d75-8c44-0fe6981ae38c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:27.993322 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e34638b-46a5-4d75-8c44-0fe6981ae38c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:27.994025 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e34638b-46a5-4d75-8c44-0fe6981ae38c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:27.994470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e34638b-46a5-4d75-8c44-0fe6981ae38c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:27.994886 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e34638b-46a5-4d75-8c44-0fe6981ae38c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:28.127243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e34638b-46a5-4d75-8c44-0fe6981ae38c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:28.134692 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e34638b-46a5-4d75-8c44-0fe6981ae38c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.153500 Oct 06 11:05:28.135250 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 126/242] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:27 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:28.185238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:28.185845 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:28.192287 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:28.192753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:28.193185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:28.193864 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:28.194317 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:28.194736 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:28.325743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:28.335861 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:28.336166 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:28.337418 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6209b74e-f9d4-4a8f-9371-1c684963b475 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.156061 Oct 06 11:05:28.338182 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 117/243] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:28 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:28.563470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c95e0167-a230-496e-929b-9a1762af0a9f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:28.564239 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c95e0167-a230-496e-929b-9a1762af0a9f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:28.570180 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c95e0167-a230-496e-929b-9a1762af0a9f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:28.570851 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c95e0167-a230-496e-929b-9a1762af0a9f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:28.571278 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c95e0167-a230-496e-929b-9a1762af0a9f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:28.571988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c95e0167-a230-496e-929b-9a1762af0a9f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:28.572433 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c95e0167-a230-496e-929b-9a1762af0a9f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:28.572854 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c95e0167-a230-496e-929b-9a1762af0a9f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:28.702147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c95e0167-a230-496e-929b-9a1762af0a9f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:28.710561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c95e0167-a230-496e-929b-9a1762af0a9f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.150528 Oct 06 11:05:28.710990 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 127/244] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:28 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:28.929462 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34f06e03-64d9-4040-8f0f-bd12c07cb332 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:28.930079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-34f06e03-64d9-4040-8f0f-bd12c07cb332 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:28.936054 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34f06e03-64d9-4040-8f0f-bd12c07cb332 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:28.936542 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34f06e03-64d9-4040-8f0f-bd12c07cb332 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:28.936982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34f06e03-64d9-4040-8f0f-bd12c07cb332 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:28.937669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34f06e03-64d9-4040-8f0f-bd12c07cb332 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:28.938147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34f06e03-64d9-4040-8f0f-bd12c07cb332 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:28.938616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34f06e03-64d9-4040-8f0f-bd12c07cb332 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:29.065427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-34f06e03-64d9-4040-8f0f-bd12c07cb332 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:29.075787 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-34f06e03-64d9-4040-8f0f-bd12c07cb332 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.150079 Oct 06 11:05:29.077511 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 118/245] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:28 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:29.158176 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-229b3adc-5775-4a52-8e79-6b3e520c8aa7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:29.158701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-229b3adc-5775-4a52-8e79-6b3e520c8aa7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:29.164570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-229b3adc-5775-4a52-8e79-6b3e520c8aa7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:29.165052 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-229b3adc-5775-4a52-8e79-6b3e520c8aa7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:29.165491 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-229b3adc-5775-4a52-8e79-6b3e520c8aa7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:29.166173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-229b3adc-5775-4a52-8e79-6b3e520c8aa7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:29.166621 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-229b3adc-5775-4a52-8e79-6b3e520c8aa7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:29.167045 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-229b3adc-5775-4a52-8e79-6b3e520c8aa7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:29.294037 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-229b3adc-5775-4a52-8e79-6b3e520c8aa7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:29.301726 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-229b3adc-5775-4a52-8e79-6b3e520c8aa7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.147871 Oct 06 11:05:29.302312 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 128/246] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:29 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:29.362686 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:29.363291 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:29.369070 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:29.369575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:29.370005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:29.370680 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:29.371128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:29.371546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:29.498309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:29.506962 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:29.508423 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:29.509506 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad17539d-c4dc-4113-aba8-a542c1d3d0de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.150988 Oct 06 11:05:29.510050 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 119/247] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:29 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:29.733106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6059f859-3656-48d9-9486-b792adccca5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:29.733747 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6059f859-3656-48d9-9486-b792adccca5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:29.737147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:29.740684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6059f859-3656-48d9-9486-b792adccca5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:29.741168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6059f859-3656-48d9-9486-b792adccca5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:29.741597 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6059f859-3656-48d9-9486-b792adccca5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:29.742280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6059f859-3656-48d9-9486-b792adccca5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:29.742724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6059f859-3656-48d9-9486-b792adccca5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:29.743757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6059f859-3656-48d9-9486-b792adccca5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:29.875690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6059f859-3656-48d9-9486-b792adccca5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:29.883466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6059f859-3656-48d9-9486-b792adccca5c tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.154096 Oct 06 11:05:29.884042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 129/248] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:29 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:30.101521 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1a09449-c733-4f07-857f-ccffd7a0bea2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:30.102064 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1a09449-c733-4f07-857f-ccffd7a0bea2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:30.107911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a09449-c733-4f07-857f-ccffd7a0bea2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:30.108398 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a09449-c733-4f07-857f-ccffd7a0bea2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:30.108835 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a09449-c733-4f07-857f-ccffd7a0bea2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:30.109527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a09449-c733-4f07-857f-ccffd7a0bea2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:30.110665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a09449-c733-4f07-857f-ccffd7a0bea2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:30.111091 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a09449-c733-4f07-857f-ccffd7a0bea2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:30.237578 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1a09449-c733-4f07-857f-ccffd7a0bea2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:30.245080 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1a09449-c733-4f07-857f-ccffd7a0bea2 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.147465 Oct 06 11:05:30.245634 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 120/249] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:30 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:30.324719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-81fd53ff-a4bc-4daf-ad1e-a9ec246f7ddf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:30.325318 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-81fd53ff-a4bc-4daf-ad1e-a9ec246f7ddf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:30.331596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81fd53ff-a4bc-4daf-ad1e-a9ec246f7ddf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:30.332109 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81fd53ff-a4bc-4daf-ad1e-a9ec246f7ddf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:30.332538 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81fd53ff-a4bc-4daf-ad1e-a9ec246f7ddf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:30.333211 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81fd53ff-a4bc-4daf-ad1e-a9ec246f7ddf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:30.333670 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81fd53ff-a4bc-4daf-ad1e-a9ec246f7ddf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:30.334067 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81fd53ff-a4bc-4daf-ad1e-a9ec246f7ddf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:30.460861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-81fd53ff-a4bc-4daf-ad1e-a9ec246f7ddf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:30.468373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-81fd53ff-a4bc-4daf-ad1e-a9ec246f7ddf tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.147458 Oct 06 11:05:30.468956 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 130/250] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:30 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:30.534637 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:30.535251 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:30.541147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:30.541629 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:30.542062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:30.542750 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:30.543198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:30.543616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:30.670042 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:30.678983 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:30.680501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:30.681601 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6f4793a-edb1-420a-83a7-7523763de167 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.151466 Oct 06 11:05:30.682157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 121/251] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:30 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:30.912129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed3af770-a09f-4131-a03a-9fd2f7dd6703 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:30.912736 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed3af770-a09f-4131-a03a-9fd2f7dd6703 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:30.918574 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed3af770-a09f-4131-a03a-9fd2f7dd6703 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:30.919057 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed3af770-a09f-4131-a03a-9fd2f7dd6703 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:30.919491 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed3af770-a09f-4131-a03a-9fd2f7dd6703 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:30.920196 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed3af770-a09f-4131-a03a-9fd2f7dd6703 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:30.920644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed3af770-a09f-4131-a03a-9fd2f7dd6703 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:30.921061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed3af770-a09f-4131-a03a-9fd2f7dd6703 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:31.048627 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ed3af770-a09f-4131-a03a-9fd2f7dd6703 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:31.056105 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed3af770-a09f-4131-a03a-9fd2f7dd6703 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.147679 Oct 06 11:05:31.056668 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 131/252] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:30 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:31.267659 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14d73f26-df52-4144-9fd0-13a159abf612 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:31.268317 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14d73f26-df52-4144-9fd0-13a159abf612 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:31.274395 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d73f26-df52-4144-9fd0-13a159abf612 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:31.274873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d73f26-df52-4144-9fd0-13a159abf612 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:31.275304 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d73f26-df52-4144-9fd0-13a159abf612 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:31.276015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d73f26-df52-4144-9fd0-13a159abf612 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:31.276469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d73f26-df52-4144-9fd0-13a159abf612 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:31.276887 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d73f26-df52-4144-9fd0-13a159abf612 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:31.406188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-14d73f26-df52-4144-9fd0-13a159abf612 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:31.414305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14d73f26-df52-4144-9fd0-13a159abf612 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.150599 Oct 06 11:05:31.414862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 122/253] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:31 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:31.491853 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5c2b6bc-8252-4caf-b878-6e085ef95241 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:31.492464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5c2b6bc-8252-4caf-b878-6e085ef95241 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:31.498383 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c2b6bc-8252-4caf-b878-6e085ef95241 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:31.498861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c2b6bc-8252-4caf-b878-6e085ef95241 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:31.499292 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c2b6bc-8252-4caf-b878-6e085ef95241 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:31.500003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c2b6bc-8252-4caf-b878-6e085ef95241 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:31.500473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c2b6bc-8252-4caf-b878-6e085ef95241 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:31.500897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c2b6bc-8252-4caf-b878-6e085ef95241 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:31.629407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d5c2b6bc-8252-4caf-b878-6e085ef95241 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:31.636862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5c2b6bc-8252-4caf-b878-6e085ef95241 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.148802 Oct 06 11:05:31.637419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 132/254] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:31 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:31.707237 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:31.707868 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:31.713671 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:31.714166 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:31.714631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:31.715299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:31.715754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:31.716208 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:31.841367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:31.849994 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:31.851484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:31.852627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf033d80-a0d0-4134-8785-69d5b08cf6e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.150122 Oct 06 11:05:31.853187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 123/255] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:31 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:32.080529 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2cf2173-ec2d-45fc-899e-e3c6368b2cf7 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:32.081165 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e2cf2173-ec2d-45fc-899e-e3c6368b2cf7 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:32.087009 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2cf2173-ec2d-45fc-899e-e3c6368b2cf7 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:32.087563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2cf2173-ec2d-45fc-899e-e3c6368b2cf7 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:32.088030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2cf2173-ec2d-45fc-899e-e3c6368b2cf7 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:32.088709 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2cf2173-ec2d-45fc-899e-e3c6368b2cf7 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:32.089207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2cf2173-ec2d-45fc-899e-e3c6368b2cf7 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:32.089629 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2cf2173-ec2d-45fc-899e-e3c6368b2cf7 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:32.217159 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e2cf2173-ec2d-45fc-899e-e3c6368b2cf7 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:32.224618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e2cf2173-ec2d-45fc-899e-e3c6368b2cf7 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.148635 Oct 06 11:05:32.225179 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 133/256] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:32 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:32.437642 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1722804-c06f-4792-9329-4ba95c49482f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:32.438900 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1722804-c06f-4792-9329-4ba95c49482f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:32.444705 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1722804-c06f-4792-9329-4ba95c49482f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:32.445185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1722804-c06f-4792-9329-4ba95c49482f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:32.445612 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1722804-c06f-4792-9329-4ba95c49482f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:32.446287 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1722804-c06f-4792-9329-4ba95c49482f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:32.446733 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1722804-c06f-4792-9329-4ba95c49482f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:32.447153 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1722804-c06f-4792-9329-4ba95c49482f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:32.574741 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1722804-c06f-4792-9329-4ba95c49482f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:32.582873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1722804-c06f-4792-9329-4ba95c49482f tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.149185 Oct 06 11:05:32.583467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 124/257] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:32 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:32.659588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79508376-fbfc-4f20-8be0-815125441614 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:32.660328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79508376-fbfc-4f20-8be0-815125441614 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:32.666172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79508376-fbfc-4f20-8be0-815125441614 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:32.666656 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79508376-fbfc-4f20-8be0-815125441614 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:32.667103 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79508376-fbfc-4f20-8be0-815125441614 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:32.667794 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79508376-fbfc-4f20-8be0-815125441614 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:32.668276 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79508376-fbfc-4f20-8be0-815125441614 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:32.668704 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79508376-fbfc-4f20-8be0-815125441614 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:32.800248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-79508376-fbfc-4f20-8be0-815125441614 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:32.807821 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79508376-fbfc-4f20-8be0-815125441614 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.152127 Oct 06 11:05:32.808409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 134/258] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:32 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:32.876502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:32.877145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:32.883000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:32.883480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:32.883946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:32.884627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:32.885082 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:32.885504 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:33.204091 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:33.212100 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:33.213541 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:33.214635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77a02422-2847-4a91-a8b8-31ba9089a1da tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.342347 Oct 06 11:05:33.215216 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 125/259] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:32 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:33.246383 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c1c6cf8-1e07-43cb-87e5-04a167dea342 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:33.246991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c1c6cf8-1e07-43cb-87e5-04a167dea342 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:33.252920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c1c6cf8-1e07-43cb-87e5-04a167dea342 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:33.253400 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c1c6cf8-1e07-43cb-87e5-04a167dea342 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:33.253834 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c1c6cf8-1e07-43cb-87e5-04a167dea342 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:33.254518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c1c6cf8-1e07-43cb-87e5-04a167dea342 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:33.254971 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c1c6cf8-1e07-43cb-87e5-04a167dea342 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:33.255392 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c1c6cf8-1e07-43cb-87e5-04a167dea342 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:33.273789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:33.381030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c1c6cf8-1e07-43cb-87e5-04a167dea342 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:33.388977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c1c6cf8-1e07-43cb-87e5-04a167dea342 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.146364 Oct 06 11:05:33.389548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 135/260] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:33 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:33.607016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b451190b-adbc-4696-8bdf-107bd3b579ab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:33.607621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b451190b-adbc-4696-8bdf-107bd3b579ab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:33.613842 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b451190b-adbc-4696-8bdf-107bd3b579ab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:33.614333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b451190b-adbc-4696-8bdf-107bd3b579ab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:33.614770 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b451190b-adbc-4696-8bdf-107bd3b579ab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:33.615476 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b451190b-adbc-4696-8bdf-107bd3b579ab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:33.615974 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b451190b-adbc-4696-8bdf-107bd3b579ab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:33.616481 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b451190b-adbc-4696-8bdf-107bd3b579ab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:33.748819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b451190b-adbc-4696-8bdf-107bd3b579ab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:33.757278 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b451190b-adbc-4696-8bdf-107bd3b579ab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.154513 Oct 06 11:05:33.758033 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 126/261] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:33 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:33.831029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f8d7898-0da8-4ff6-a838-0d0c47e5645a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:33.831642 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6f8d7898-0da8-4ff6-a838-0d0c47e5645a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:33.837563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f8d7898-0da8-4ff6-a838-0d0c47e5645a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:33.838046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f8d7898-0da8-4ff6-a838-0d0c47e5645a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:33.838481 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f8d7898-0da8-4ff6-a838-0d0c47e5645a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:33.839171 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f8d7898-0da8-4ff6-a838-0d0c47e5645a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:33.839620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f8d7898-0da8-4ff6-a838-0d0c47e5645a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:33.840146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f8d7898-0da8-4ff6-a838-0d0c47e5645a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:33.968709 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6f8d7898-0da8-4ff6-a838-0d0c47e5645a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:33.976759 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f8d7898-0da8-4ff6-a838-0d0c47e5645a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.150166 Oct 06 11:05:33.977362 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 136/262] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:33 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:34.240777 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:34.241381 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:34.247184 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:34.247660 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:34.248148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:34.248807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:34.249253 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:34.249675 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:34.378171 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:34.386161 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:34.387594 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:34.388706 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b65a6a10-400f-49e8-80a0-e831a9f85748 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.152007 Oct 06 11:05:34.389254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 127/263] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:34 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:34.413871 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-96ace5fc-1d62-4244-9f7a-55e996d8dc3b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:34.414505 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-96ace5fc-1d62-4244-9f7a-55e996d8dc3b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:34.421102 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96ace5fc-1d62-4244-9f7a-55e996d8dc3b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:34.421627 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96ace5fc-1d62-4244-9f7a-55e996d8dc3b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:34.422068 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96ace5fc-1d62-4244-9f7a-55e996d8dc3b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:34.423429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96ace5fc-1d62-4244-9f7a-55e996d8dc3b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:34.424034 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96ace5fc-1d62-4244-9f7a-55e996d8dc3b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:34.424464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96ace5fc-1d62-4244-9f7a-55e996d8dc3b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:34.552627 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-96ace5fc-1d62-4244-9f7a-55e996d8dc3b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:34.560285 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-96ace5fc-1d62-4244-9f7a-55e996d8dc3b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.150433 Oct 06 11:05:34.560926 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 137/264] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:34 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:34.783702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99abd018-6ffd-4577-b931-b7f2ebee1777 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:34.784428 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99abd018-6ffd-4577-b931-b7f2ebee1777 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:34.790605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99abd018-6ffd-4577-b931-b7f2ebee1777 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:34.791119 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99abd018-6ffd-4577-b931-b7f2ebee1777 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:34.792369 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99abd018-6ffd-4577-b931-b7f2ebee1777 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:34.793416 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99abd018-6ffd-4577-b931-b7f2ebee1777 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:34.793910 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99abd018-6ffd-4577-b931-b7f2ebee1777 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:34.794336 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99abd018-6ffd-4577-b931-b7f2ebee1777 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:34.943784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-99abd018-6ffd-4577-b931-b7f2ebee1777 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:34.952578 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99abd018-6ffd-4577-b931-b7f2ebee1777 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.174951 Oct 06 11:05:34.953314 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 128/265] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:34 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:35.001799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-156f17ac-5fae-49c2-b18a-3a1398cc9869 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:35.002577 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-156f17ac-5fae-49c2-b18a-3a1398cc9869 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:35.008926 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-156f17ac-5fae-49c2-b18a-3a1398cc9869 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:35.009413 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-156f17ac-5fae-49c2-b18a-3a1398cc9869 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:35.009925 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-156f17ac-5fae-49c2-b18a-3a1398cc9869 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:35.010808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-156f17ac-5fae-49c2-b18a-3a1398cc9869 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:35.011471 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-156f17ac-5fae-49c2-b18a-3a1398cc9869 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:35.012100 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-156f17ac-5fae-49c2-b18a-3a1398cc9869 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:35.193592 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-156f17ac-5fae-49c2-b18a-3a1398cc9869 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:35.206042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-156f17ac-5fae-49c2-b18a-3a1398cc9869 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.209868 Oct 06 11:05:35.207241 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 138/266] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:34 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:35.414410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:35.423607 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:35.444777 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:35.447711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:35.448517 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:35.449239 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:35.449701 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:35.450241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:35.587681 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a226b89f-b446-4ca3-a3b0-a0edb5c45a02 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:35.588525 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a226b89f-b446-4ca3-a3b0-a0edb5c45a02 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:35.596330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a226b89f-b446-4ca3-a3b0-a0edb5c45a02 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:35.596829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a226b89f-b446-4ca3-a3b0-a0edb5c45a02 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:35.597269 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a226b89f-b446-4ca3-a3b0-a0edb5c45a02 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:35.597993 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a226b89f-b446-4ca3-a3b0-a0edb5c45a02 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:35.598639 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a226b89f-b446-4ca3-a3b0-a0edb5c45a02 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:35.599062 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a226b89f-b446-4ca3-a3b0-a0edb5c45a02 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:35.650768 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:35.663071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:35.665762 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:35.667529 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c24235e-7be5-4b57-8b19-b4de6793a48b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.256574 Oct 06 11:05:35.668353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 129/267] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:35 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:35.883108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a226b89f-b446-4ca3-a3b0-a0edb5c45a02 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:35.892495 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a226b89f-b446-4ca3-a3b0-a0edb5c45a02 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.308328 Oct 06 11:05:35.894094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 139/268] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:35 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:35.982160 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6a49a8a-6ca2-4522-8036-0b3c354de9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:35.983060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6a49a8a-6ca2-4522-8036-0b3c354de9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:35.997073 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6a49a8a-6ca2-4522-8036-0b3c354de9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:35.997583 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6a49a8a-6ca2-4522-8036-0b3c354de9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:35.997992 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6a49a8a-6ca2-4522-8036-0b3c354de9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:35.999042 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6a49a8a-6ca2-4522-8036-0b3c354de9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:35.999498 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6a49a8a-6ca2-4522-8036-0b3c354de9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:35.999946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6a49a8a-6ca2-4522-8036-0b3c354de9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:36.155529 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6a49a8a-6ca2-4522-8036-0b3c354de9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:36.163730 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6a49a8a-6ca2-4522-8036-0b3c354de9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1362 microversion: 2.1 time: 0.191490 Oct 06 11:05:36.164997 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 130/269] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:35 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:36.230949 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bf846ddb-4645-404b-8235-2bc07c7e9348 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:36.231470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bf846ddb-4645-404b-8235-2bc07c7e9348 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:36.239918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf846ddb-4645-404b-8235-2bc07c7e9348 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:36.240473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf846ddb-4645-404b-8235-2bc07c7e9348 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:36.242194 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf846ddb-4645-404b-8235-2bc07c7e9348 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:36.243155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf846ddb-4645-404b-8235-2bc07c7e9348 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:36.244690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf846ddb-4645-404b-8235-2bc07c7e9348 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:36.245430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf846ddb-4645-404b-8235-2bc07c7e9348 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:36.697680 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:36.698307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:36.713723 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:36.716469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:36.719618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:36.720125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:36.720871 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:36.735945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:36.738119 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:36.785208 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bf846ddb-4645-404b-8235-2bc07c7e9348 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:36.793884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bf846ddb-4645-404b-8235-2bc07c7e9348 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.567944 Oct 06 11:05:36.800755 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 140/270] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:36 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:36.918815 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ba7d038-94f8-4029-8e30-371e67902378 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:36.919441 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6ba7d038-94f8-4029-8e30-371e67902378 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:36.931199 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ba7d038-94f8-4029-8e30-371e67902378 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:36.935430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ba7d038-94f8-4029-8e30-371e67902378 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:36.935916 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ba7d038-94f8-4029-8e30-371e67902378 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:36.936650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ba7d038-94f8-4029-8e30-371e67902378 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:36.937112 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ba7d038-94f8-4029-8e30-371e67902378 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:36.937534 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ba7d038-94f8-4029-8e30-371e67902378 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:36.956807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:36.968007 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:36.969893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:36.971215 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-156c6610-518b-4b55-84c4-3cbc94f1a1a4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.279860 Oct 06 11:05:36.972264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 131/271] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:36 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:37.093489 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0f2b6155-fa7e-4a96-983b-5bde23045596 req-630dbecd-bc3f-468c-bbd1-0295f08cd764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41685b83-a75b-4abc-814c-c9a4424f2c65", "name": "network-vif-plugged", "status": "completed", "tag": "5a60437f-d87b-4705-ab02-ee352497d7bb"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:05:37.126713 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0f2b6155-fa7e-4a96-983b-5bde23045596 req-630dbecd-bc3f-468c-bbd1-0295f08cd764 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:37.128896 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0f2b6155-fa7e-4a96-983b-5bde23045596 req-630dbecd-bc3f-468c-bbd1-0295f08cd764 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:37.132836 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0f2b6155-fa7e-4a96-983b-5bde23045596 req-630dbecd-bc3f-468c-bbd1-0295f08cd764 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:37.156915 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0f2b6155-fa7e-4a96-983b-5bde23045596 req-630dbecd-bc3f-468c-bbd1-0295f08cd764 service nova] Creating event network-vif-plugged:5a60437f-d87b-4705-ab02-ee352497d7bb for instance 41685b83-a75b-4abc-814c-c9a4424f2c65 on hv-cinder-86020 Oct 06 11:05:37.169128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0f2b6155-fa7e-4a96-983b-5bde23045596 req-630dbecd-bc3f-468c-bbd1-0295f08cd764 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092332 Oct 06 11:05:37.170977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 132/272] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:05:37.193457 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db6efe40-bcb4-40a8-b5df-22a90c407e2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:37.196901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db6efe40-bcb4-40a8-b5df-22a90c407e2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:37.208256 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ba7d038-94f8-4029-8e30-371e67902378 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:37.215085 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db6efe40-bcb4-40a8-b5df-22a90c407e2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:37.217652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db6efe40-bcb4-40a8-b5df-22a90c407e2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:37.217652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db6efe40-bcb4-40a8-b5df-22a90c407e2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:37.219790 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ba7d038-94f8-4029-8e30-371e67902378 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.306459 Oct 06 11:05:37.220196 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db6efe40-bcb4-40a8-b5df-22a90c407e2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:37.221953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db6efe40-bcb4-40a8-b5df-22a90c407e2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:37.223304 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db6efe40-bcb4-40a8-b5df-22a90c407e2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:37.224508 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 141/273] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:36 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:37.231052 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:37.465307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-db6efe40-bcb4-40a8-b5df-22a90c407e2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:37.475590 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db6efe40-bcb4-40a8-b5df-22a90c407e2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1547 microversion: 2.1 time: 0.291125 Oct 06 11:05:37.476443 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 133/274] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:37 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1547 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:37.503514 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd37bd03-2494-4e63-9586-0d64cb198dfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:37.503993 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd37bd03-2494-4e63-9586-0d64cb198dfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:37.510861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd37bd03-2494-4e63-9586-0d64cb198dfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:37.511344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd37bd03-2494-4e63-9586-0d64cb198dfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:37.511796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd37bd03-2494-4e63-9586-0d64cb198dfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:37.512485 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd37bd03-2494-4e63-9586-0d64cb198dfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:37.512989 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd37bd03-2494-4e63-9586-0d64cb198dfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:37.513339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd37bd03-2494-4e63-9586-0d64cb198dfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:37.648186 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd37bd03-2494-4e63-9586-0d64cb198dfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149058 Oct 06 11:05:37.648764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 142/275] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Oct 6 11:05:37 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:05:37.821579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8b2e3519-5698-4c5d-92bf-1373e16784b5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:37.822576 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8b2e3519-5698-4c5d-92bf-1373e16784b5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:37.833516 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b2e3519-5698-4c5d-92bf-1373e16784b5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:37.834457 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b2e3519-5698-4c5d-92bf-1373e16784b5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:37.835277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b2e3519-5698-4c5d-92bf-1373e16784b5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:37.837028 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b2e3519-5698-4c5d-92bf-1373e16784b5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:37.837732 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b2e3519-5698-4c5d-92bf-1373e16784b5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:37.839099 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b2e3519-5698-4c5d-92bf-1373e16784b5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:37.998400 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:37.999092 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:38.023891 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:38.024948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:38.029204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:38.030674 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:38.034939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:38.037813 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:38.096197 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b2e3519-5698-4c5d-92bf-1373e16784b5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:38.113185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8b2e3519-5698-4c5d-92bf-1373e16784b5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.299239 Oct 06 11:05:38.136226 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 134/276] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:37 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:38.245189 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d28f10f4-ed21-46d7-b724-0b92d5f6a966 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:38.245894 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d28f10f4-ed21-46d7-b724-0b92d5f6a966 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:38.257557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d28f10f4-ed21-46d7-b724-0b92d5f6a966 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:38.258221 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d28f10f4-ed21-46d7-b724-0b92d5f6a966 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:38.259180 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d28f10f4-ed21-46d7-b724-0b92d5f6a966 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:38.260883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d28f10f4-ed21-46d7-b724-0b92d5f6a966 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:38.261935 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d28f10f4-ed21-46d7-b724-0b92d5f6a966 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:38.262851 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d28f10f4-ed21-46d7-b724-0b92d5f6a966 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:38.333266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:38.341797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:38.343253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:38.344476 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a8621441-48d7-4bfe-b2c5-5dca3339aede tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.351585 Oct 06 11:05:38.360231 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 143/277] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:37 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:38.574472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d28f10f4-ed21-46d7-b724-0b92d5f6a966 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:38.585130 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d28f10f4-ed21-46d7-b724-0b92d5f6a966 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.343296 Oct 06 11:05:38.586199 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 135/278] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:38 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:39.144515 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ecb5bfd-80fb-449a-a9e6-b5924747ab84 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:39.145429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ecb5bfd-80fb-449a-a9e6-b5924747ab84 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:39.152261 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ecb5bfd-80fb-449a-a9e6-b5924747ab84 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:39.153936 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ecb5bfd-80fb-449a-a9e6-b5924747ab84 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:39.154480 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ecb5bfd-80fb-449a-a9e6-b5924747ab84 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:39.155590 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ecb5bfd-80fb-449a-a9e6-b5924747ab84 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:39.156173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ecb5bfd-80fb-449a-a9e6-b5924747ab84 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:39.156876 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ecb5bfd-80fb-449a-a9e6-b5924747ab84 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:39.372499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:39.373995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:39.386687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:39.388798 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:39.389322 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:39.390256 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:39.393682 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:39.395692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:39.526178 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ecb5bfd-80fb-449a-a9e6-b5924747ab84 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:39.536600 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ecb5bfd-80fb-449a-a9e6-b5924747ab84 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.397879 Oct 06 11:05:39.556197 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 144/279] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:39 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:39.609064 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7dcf777-20df-4edf-9aee-1f34c25f3449 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:39.610596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a7dcf777-20df-4edf-9aee-1f34c25f3449 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:39.621468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7dcf777-20df-4edf-9aee-1f34c25f3449 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:39.621965 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7dcf777-20df-4edf-9aee-1f34c25f3449 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:39.622582 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7dcf777-20df-4edf-9aee-1f34c25f3449 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:39.623603 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7dcf777-20df-4edf-9aee-1f34c25f3449 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:39.624241 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7dcf777-20df-4edf-9aee-1f34c25f3449 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:39.624820 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7dcf777-20df-4edf-9aee-1f34c25f3449 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:39.626153 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:39.638410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:39.640257 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:39.641573 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c201862-9a70-4fe5-ad89-ca5a94df12f0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.275196 Oct 06 11:05:39.653227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 136/280] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:39 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:39.769206 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-14a8d05f-8c35-44c6-806d-b4a8f5139a3c req-c4bc20db-49cf-441e-b159-ad8288f9bd65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb86039-b159-435a-b022-4396a59b657c", "tag": "f595a1a4-6f82-46d6-9c95-1fd836a18532"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:05:39.782965 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-14a8d05f-8c35-44c6-806d-b4a8f5139a3c req-c4bc20db-49cf-441e-b159-ad8288f9bd65 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:39.783447 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-14a8d05f-8c35-44c6-806d-b4a8f5139a3c req-c4bc20db-49cf-441e-b159-ad8288f9bd65 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:39.788298 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-14a8d05f-8c35-44c6-806d-b4a8f5139a3c req-c4bc20db-49cf-441e-b159-ad8288f9bd65 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:39.834436 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-14a8d05f-8c35-44c6-806d-b4a8f5139a3c req-c4bc20db-49cf-441e-b159-ad8288f9bd65 service nova] Creating event network-changed:f595a1a4-6f82-46d6-9c95-1fd836a18532 for instance 3eb86039-b159-435a-b022-4396a59b657c on hv-cinder-86020 Oct 06 11:05:39.850708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-14a8d05f-8c35-44c6-806d-b4a8f5139a3c req-c4bc20db-49cf-441e-b159-ad8288f9bd65 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085172 Oct 06 11:05:39.851560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 137/281] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:05:39.876155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7dcf777-20df-4edf-9aee-1f34c25f3449 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:39.887552 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a7dcf777-20df-4edf-9aee-1f34c25f3449 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.283006 Oct 06 11:05:39.888706 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 145/282] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:39 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:40.562171 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ebc0a22-87e0-400f-a751-767981117a1f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:40.563022 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2ebc0a22-87e0-400f-a751-767981117a1f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:40.570397 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ebc0a22-87e0-400f-a751-767981117a1f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:40.571125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ebc0a22-87e0-400f-a751-767981117a1f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:40.571767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ebc0a22-87e0-400f-a751-767981117a1f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:40.572695 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ebc0a22-87e0-400f-a751-767981117a1f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:40.573341 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ebc0a22-87e0-400f-a751-767981117a1f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:40.574016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ebc0a22-87e0-400f-a751-767981117a1f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:40.681614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:40.683806 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:40.695901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:40.696583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:40.697287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:40.698150 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:40.699308 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:40.699996 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:40.734531 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ebc0a22-87e0-400f-a751-767981117a1f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:40.747798 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2ebc0a22-87e0-400f-a751-767981117a1f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.189502 Oct 06 11:05:40.749157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 138/283] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:40 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:40.886825 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:40.899507 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:40.901317 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:40.902640 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-71b9d2c3-3fed-427e-8784-b84e37fe0d0a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.225422 Oct 06 11:05:40.921681 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 146/284] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:40 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:40.924493 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d97e40b0-9147-4100-b195-1a789c7aa65f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:40.926164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d97e40b0-9147-4100-b195-1a789c7aa65f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:40.935184 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d97e40b0-9147-4100-b195-1a789c7aa65f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:40.936629 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d97e40b0-9147-4100-b195-1a789c7aa65f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:40.937558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d97e40b0-9147-4100-b195-1a789c7aa65f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:40.939201 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d97e40b0-9147-4100-b195-1a789c7aa65f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:40.939901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d97e40b0-9147-4100-b195-1a789c7aa65f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:40.941131 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d97e40b0-9147-4100-b195-1a789c7aa65f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:41.161970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d97e40b0-9147-4100-b195-1a789c7aa65f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:41.170468 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d97e40b0-9147-4100-b195-1a789c7aa65f tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.251069 Oct 06 11:05:41.184332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 139/285] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:40 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:41.774598 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-afacb608-3b32-4a72-9bd1-67651e5d19d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:41.775215 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-afacb608-3b32-4a72-9bd1-67651e5d19d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:41.783090 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afacb608-3b32-4a72-9bd1-67651e5d19d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:41.783562 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afacb608-3b32-4a72-9bd1-67651e5d19d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:41.784087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afacb608-3b32-4a72-9bd1-67651e5d19d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:41.784839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afacb608-3b32-4a72-9bd1-67651e5d19d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:41.785400 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afacb608-3b32-4a72-9bd1-67651e5d19d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:41.785838 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afacb608-3b32-4a72-9bd1-67651e5d19d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:41.934573 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:41.935788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:41.945645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:41.946194 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:41.946586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:41.947295 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:41.949345 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:41.949797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:41.972266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-afacb608-3b32-4a72-9bd1-67651e5d19d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:41.980929 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-afacb608-3b32-4a72-9bd1-67651e5d19d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1321 microversion: 2.1 time: 0.210842 Oct 06 11:05:41.987871 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 147/286] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:41 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:42.134496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:42.145995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:42.148166 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:42.149411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cbe2cdfc-867d-4830-8a1c-147d8112db3d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.219266 Oct 06 11:05:42.150209 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 140/287] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:41 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:42.195167 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ec5184c2-cb15-45f0-8726-80792d6e6710 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:42.195782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ec5184c2-cb15-45f0-8726-80792d6e6710 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:42.205006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec5184c2-cb15-45f0-8726-80792d6e6710 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:42.205990 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec5184c2-cb15-45f0-8726-80792d6e6710 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:42.206625 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec5184c2-cb15-45f0-8726-80792d6e6710 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:42.207540 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec5184c2-cb15-45f0-8726-80792d6e6710 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:42.208139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec5184c2-cb15-45f0-8726-80792d6e6710 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:42.208771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec5184c2-cb15-45f0-8726-80792d6e6710 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:42.404374 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ec5184c2-cb15-45f0-8726-80792d6e6710 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:42.416287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ec5184c2-cb15-45f0-8726-80792d6e6710 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.225077 Oct 06 11:05:42.418347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 148/288] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:42 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:43.005554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1b42b36-8763-499c-af6e-a9f2e3c21c4a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:43.007101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f1b42b36-8763-499c-af6e-a9f2e3c21c4a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:43.015964 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1b42b36-8763-499c-af6e-a9f2e3c21c4a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:43.016873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1b42b36-8763-499c-af6e-a9f2e3c21c4a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:43.017492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1b42b36-8763-499c-af6e-a9f2e3c21c4a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:43.019343 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1b42b36-8763-499c-af6e-a9f2e3c21c4a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:43.020238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1b42b36-8763-499c-af6e-a9f2e3c21c4a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:43.020815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1b42b36-8763-499c-af6e-a9f2e3c21c4a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:43.176185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:43.176808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:43.180267 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f1b42b36-8763-499c-af6e-a9f2e3c21c4a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:43.197033 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:43.200367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:43.200884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:43.201724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:43.202421 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:43.204099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:43.207897 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1b42b36-8763-499c-af6e-a9f2e3c21c4a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1516 microversion: 2.1 time: 0.207741 Oct 06 11:05:43.208477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 141/289] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:42 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:43.233045 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44f4c6da-39bc-4731-bd7f-855db9c0e987 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:05:43.236166 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44f4c6da-39bc-4731-bd7f-855db9c0e987 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:43.242642 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44f4c6da-39bc-4731-bd7f-855db9c0e987 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:43.243232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44f4c6da-39bc-4731-bd7f-855db9c0e987 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:43.243792 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44f4c6da-39bc-4731-bd7f-855db9c0e987 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:43.244715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44f4c6da-39bc-4731-bd7f-855db9c0e987 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:43.245270 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44f4c6da-39bc-4731-bd7f-855db9c0e987 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:43.245782 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44f4c6da-39bc-4731-bd7f-855db9c0e987 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:43.320288 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-44f4c6da-39bc-4731-bd7f-855db9c0e987 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lazy-loading 'flavor' on Instance uuid ec9864b6-cb13-4dc0-97d2-e155a1717ec9 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:05:43.376540 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:43.385704 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:43.387146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:43.388556 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aaff64af-8896-4051-a7f7-fad4f0bc0f65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.217348 Oct 06 11:05:43.416534 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 149/290] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:43 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:43.447028 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b3f90116-8727-4766-8988-84e46ed4e5d1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:43.447739 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b3f90116-8727-4766-8988-84e46ed4e5d1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:43.459146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3f90116-8727-4766-8988-84e46ed4e5d1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:43.460319 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3f90116-8727-4766-8988-84e46ed4e5d1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:43.462269 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3f90116-8727-4766-8988-84e46ed4e5d1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:43.463465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3f90116-8727-4766-8988-84e46ed4e5d1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:43.464105 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3f90116-8727-4766-8988-84e46ed4e5d1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:43.464638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3f90116-8727-4766-8988-84e46ed4e5d1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:43.495285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44f4c6da-39bc-4731-bd7f-855db9c0e987 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9/action" status: 200 len: 32 microversion: 2.1 time: 0.266214 Oct 06 11:05:43.495928 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 142/291] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:05:43 2022] POST /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9/action => generated 32 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 11:05:43.508341 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c409b15b-7e95-458e-909d-54845f5dbf6f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:43.509571 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c409b15b-7e95-458e-909d-54845f5dbf6f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:43.518961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c409b15b-7e95-458e-909d-54845f5dbf6f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:43.519457 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c409b15b-7e95-458e-909d-54845f5dbf6f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:43.519985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c409b15b-7e95-458e-909d-54845f5dbf6f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:43.520745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c409b15b-7e95-458e-909d-54845f5dbf6f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:43.521202 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c409b15b-7e95-458e-909d-54845f5dbf6f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:43.522510 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c409b15b-7e95-458e-909d-54845f5dbf6f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:43.715953 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b3f90116-8727-4766-8988-84e46ed4e5d1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:43.722697 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c409b15b-7e95-458e-909d-54845f5dbf6f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:43.732779 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b3f90116-8727-4766-8988-84e46ed4e5d1 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.293497 Oct 06 11:05:43.733312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c409b15b-7e95-458e-909d-54845f5dbf6f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.228760 Oct 06 11:05:43.733442 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 150/292] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:43 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:43.734200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 143/293] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:43 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:44.417623 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:44.418235 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:44.424685 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:44.425166 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:44.425602 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:44.426283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:44.426733 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:44.427155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:44.561524 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:44.570611 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:44.572095 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:44.573215 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-120f48f4-4101-4873-9404-e400b19d12ef tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.159451 Oct 06 11:05:44.573769 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 151/294] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:44 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:44.756941 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d32bb95-e768-4969-aecf-9269c4ecc89d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:44.757556 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d32bb95-e768-4969-aecf-9269c4ecc89d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:44.758538 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2607f3e4-db38-4535-b3b4-d6a8abb987ff tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:44.759146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2607f3e4-db38-4535-b3b4-d6a8abb987ff tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:44.763474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d32bb95-e768-4969-aecf-9269c4ecc89d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:44.763997 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d32bb95-e768-4969-aecf-9269c4ecc89d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:44.764433 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d32bb95-e768-4969-aecf-9269c4ecc89d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:44.764972 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2607f3e4-db38-4535-b3b4-d6a8abb987ff tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:44.765123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d32bb95-e768-4969-aecf-9269c4ecc89d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:44.765457 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2607f3e4-db38-4535-b3b4-d6a8abb987ff tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:44.765561 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d32bb95-e768-4969-aecf-9269c4ecc89d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:44.765913 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2607f3e4-db38-4535-b3b4-d6a8abb987ff tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:44.766012 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d32bb95-e768-4969-aecf-9269c4ecc89d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:44.766601 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2607f3e4-db38-4535-b3b4-d6a8abb987ff tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:44.767048 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2607f3e4-db38-4535-b3b4-d6a8abb987ff tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:44.767469 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2607f3e4-db38-4535-b3b4-d6a8abb987ff tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:44.785825 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:44.898142 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d32bb95-e768-4969-aecf-9269c4ecc89d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:44.899744 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2607f3e4-db38-4535-b3b4-d6a8abb987ff tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:44.905977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d32bb95-e768-4969-aecf-9269c4ecc89d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.152839 Oct 06 11:05:44.907169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 144/295] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:44 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:44.908170 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2607f3e4-db38-4535-b3b4-d6a8abb987ff tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1314 microversion: 2.1 time: 0.153340 Oct 06 11:05:44.908737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 152/296] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:44 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:45.599169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:45.599799 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:45.605946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:45.606490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:45.607065 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:45.607830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:45.608366 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:45.608858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:45.740206 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:45.750758 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:45.752830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:45.754383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97f34da2-e78b-4336-bcb0-e2288bee0e2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.159925 Oct 06 11:05:45.755464 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 145/297] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:45 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:45.932312 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d97d3bb-8c1d-498a-a9f6-0cabb929cd2d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:45.933177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d97d3bb-8c1d-498a-a9f6-0cabb929cd2d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:45.940823 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d97d3bb-8c1d-498a-a9f6-0cabb929cd2d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:45.942518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d97d3bb-8c1d-498a-a9f6-0cabb929cd2d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:45.942727 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c3967ff-9a6c-4fd6-95a2-767bfce268c2 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:45.943480 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d97d3bb-8c1d-498a-a9f6-0cabb929cd2d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:45.944034 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d97d3bb-8c1d-498a-a9f6-0cabb929cd2d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:45.946657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6c3967ff-9a6c-4fd6-95a2-767bfce268c2 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:45.956326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d97d3bb-8c1d-498a-a9f6-0cabb929cd2d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:45.956326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d97d3bb-8c1d-498a-a9f6-0cabb929cd2d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:45.973852 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3967ff-9a6c-4fd6-95a2-767bfce268c2 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:45.975344 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3967ff-9a6c-4fd6-95a2-767bfce268c2 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:45.976535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3967ff-9a6c-4fd6-95a2-767bfce268c2 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:45.981373 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3967ff-9a6c-4fd6-95a2-767bfce268c2 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:45.982578 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3967ff-9a6c-4fd6-95a2-767bfce268c2 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:45.983624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3967ff-9a6c-4fd6-95a2-767bfce268c2 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:46.117005 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d97d3bb-8c1d-498a-a9f6-0cabb929cd2d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:46.126293 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d97d3bb-8c1d-498a-a9f6-0cabb929cd2d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.198218 Oct 06 11:05:46.126869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 153/298] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:45 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:46.150335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c3967ff-9a6c-4fd6-95a2-767bfce268c2 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:46.159422 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6c3967ff-9a6c-4fd6-95a2-767bfce268c2 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1500 microversion: 2.1 time: 0.230311 Oct 06 11:05:46.160030 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 146/299] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:45 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1500 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:46.779164 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:46.779934 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:46.786304 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:46.786855 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:46.787368 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:46.788288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:46.788745 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:46.789175 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:46.942221 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:46.951441 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:46.952578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:46.953962 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0be19a0-856b-4056-bc0a-75062c646766 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.178899 Oct 06 11:05:46.954845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 154/300] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:46 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:05:47.151147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb7aaa7b-9ca7-40d5-905a-0bcbe2b91152 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:47.152502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb7aaa7b-9ca7-40d5-905a-0bcbe2b91152 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:47.160646 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7aaa7b-9ca7-40d5-905a-0bcbe2b91152 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:47.161367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7aaa7b-9ca7-40d5-905a-0bcbe2b91152 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:47.161841 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7aaa7b-9ca7-40d5-905a-0bcbe2b91152 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:47.163534 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7aaa7b-9ca7-40d5-905a-0bcbe2b91152 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:47.164031 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7aaa7b-9ca7-40d5-905a-0bcbe2b91152 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:47.164462 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7aaa7b-9ca7-40d5-905a-0bcbe2b91152 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:47.314519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb7aaa7b-9ca7-40d5-905a-0bcbe2b91152 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:47.322299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb7aaa7b-9ca7-40d5-905a-0bcbe2b91152 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.176863 Oct 06 11:05:47.322904 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 147/301] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:47 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:47.650815 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe40088a-5b91-46fa-a791-c6641023e670 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a968865b-2838-405b-8f2e-95e27e49e7ce"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:05:47.653320 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fe40088a-5b91-46fa-a791-c6641023e670 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:47.660230 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40088a-5b91-46fa-a791-c6641023e670 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:47.660773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40088a-5b91-46fa-a791-c6641023e670 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:47.661219 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40088a-5b91-46fa-a791-c6641023e670 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:47.661927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40088a-5b91-46fa-a791-c6641023e670 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:47.662385 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40088a-5b91-46fa-a791-c6641023e670 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:47.662817 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40088a-5b91-46fa-a791-c6641023e670 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:47.980903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:47.981570 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:47.987503 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:47.988263 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:47.988698 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:47.989551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:47.990006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:47.990428 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:48.009656 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:48.134741 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:48.144022 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:48.146081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:48.147978 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49df1897-40a9-43fb-8f50-8c6d86c718aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.170381 Oct 06 11:05:48.148574 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 148/302] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:47 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:48.344232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8104d3d-3055-45f2-bd33-dcfe2907d3f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:48.345030 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8104d3d-3055-45f2-bd33-dcfe2907d3f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:48.351441 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8104d3d-3055-45f2-bd33-dcfe2907d3f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:48.352000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8104d3d-3055-45f2-bd33-dcfe2907d3f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:48.352485 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8104d3d-3055-45f2-bd33-dcfe2907d3f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:48.353227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8104d3d-3055-45f2-bd33-dcfe2907d3f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:48.354181 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8104d3d-3055-45f2-bd33-dcfe2907d3f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:48.354181 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8104d3d-3055-45f2-bd33-dcfe2907d3f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:48.516497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8104d3d-3055-45f2-bd33-dcfe2907d3f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:48.525366 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8104d3d-3055-45f2-bd33-dcfe2907d3f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.184981 Oct 06 11:05:48.525934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 149/303] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:48 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:48.658766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fe40088a-5b91-46fa-a791-c6641023e670 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "POST /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.011213 Oct 06 11:05:48.659497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 155/304] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:05:47 2022] POST /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8/os-volume_attachments => generated 194 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:05:49.175550 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:49.176679 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:49.185009 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:49.185801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:49.186591 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:49.188146 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:49.189374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:49.190754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:49.414123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:49.422685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:49.424910 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:49.426699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-443c04b1-6d21-4e44-b9f3-e944dd85aa4b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.256307 Oct 06 11:05:49.427589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 150/305] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:49 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:49.458944 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b4be7794-c935-46d0-9462-465d4c459c01 req-133b58ab-877f-458c-b1cf-3ca3e126f97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9fceeb-0987-4e4f-b34b-f524fa791d3b", "name": "network-vif-plugged", "status": "completed", "tag": "e16aada9-7c39-402c-9979-d8f302e4c39a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:05:49.469853 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b4be7794-c935-46d0-9462-465d4c459c01 req-133b58ab-877f-458c-b1cf-3ca3e126f97b service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:49.471330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b4be7794-c935-46d0-9462-465d4c459c01 req-133b58ab-877f-458c-b1cf-3ca3e126f97b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:49.472046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b4be7794-c935-46d0-9462-465d4c459c01 req-133b58ab-877f-458c-b1cf-3ca3e126f97b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:49.487173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b4be7794-c935-46d0-9462-465d4c459c01 req-133b58ab-877f-458c-b1cf-3ca3e126f97b service nova] Creating event network-vif-plugged:e16aada9-7c39-402c-9979-d8f302e4c39a for instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b on hv-cinder-86020 Oct 06 11:05:49.492893 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b4be7794-c935-46d0-9462-465d4c459c01 req-133b58ab-877f-458c-b1cf-3ca3e126f97b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041945 Oct 06 11:05:49.493755 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 156/306] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:05:49.552132 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35ecdddf-31b2-4e8a-93c7-d09b71d1e431 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:49.553327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35ecdddf-31b2-4e8a-93c7-d09b71d1e431 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:49.559555 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ecdddf-31b2-4e8a-93c7-d09b71d1e431 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:49.560134 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ecdddf-31b2-4e8a-93c7-d09b71d1e431 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:49.560581 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ecdddf-31b2-4e8a-93c7-d09b71d1e431 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:49.561294 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ecdddf-31b2-4e8a-93c7-d09b71d1e431 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:49.561752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ecdddf-31b2-4e8a-93c7-d09b71d1e431 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:49.562182 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ecdddf-31b2-4e8a-93c7-d09b71d1e431 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:49.736248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35ecdddf-31b2-4e8a-93c7-d09b71d1e431 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:49.745064 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35ecdddf-31b2-4e8a-93c7-d09b71d1e431 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.199411 Oct 06 11:05:49.745846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 151/307] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:49 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:50.452899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:50.453758 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:50.480090 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:50.480578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:50.481105 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:50.481771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:50.482304 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:50.482756 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:50.640785 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:50.650261 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:50.651736 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:50.653102 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba60e3c3-d220-4cea-ab1c-810f0aac46a9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.204408 Oct 06 11:05:50.653658 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 157/308] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:50 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:50.774906 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3d71ee4-946d-42fb-92a3-9ad10487deda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:50.775478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d3d71ee4-946d-42fb-92a3-9ad10487deda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:50.782143 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d71ee4-946d-42fb-92a3-9ad10487deda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:50.782903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d71ee4-946d-42fb-92a3-9ad10487deda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:50.783751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d71ee4-946d-42fb-92a3-9ad10487deda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:50.784789 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d71ee4-946d-42fb-92a3-9ad10487deda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:50.784921 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d71ee4-946d-42fb-92a3-9ad10487deda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:50.785342 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d71ee4-946d-42fb-92a3-9ad10487deda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:50.939421 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d3d71ee4-946d-42fb-92a3-9ad10487deda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:50.950548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d3d71ee4-946d-42fb-92a3-9ad10487deda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.180494 Oct 06 11:05:50.951176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 152/309] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:50 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:51.681722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:51.682647 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:51.691307 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:51.692747 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:51.693585 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:51.694467 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:51.695086 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:51.695700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:51.850658 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:51.862981 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:51.864992 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:51.866879 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27ed9ba8-028a-45ea-98ee-61b96eca054b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.189732 Oct 06 11:05:51.867818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 158/310] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:51 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:51.974389 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3dbf038b-fa8e-459f-b392-5f64e2b9eb85 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:51.975013 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3dbf038b-fa8e-459f-b392-5f64e2b9eb85 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:51.980971 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dbf038b-fa8e-459f-b392-5f64e2b9eb85 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:51.981849 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dbf038b-fa8e-459f-b392-5f64e2b9eb85 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:51.982259 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dbf038b-fa8e-459f-b392-5f64e2b9eb85 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:51.983386 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dbf038b-fa8e-459f-b392-5f64e2b9eb85 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:51.984173 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dbf038b-fa8e-459f-b392-5f64e2b9eb85 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:51.984603 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dbf038b-fa8e-459f-b392-5f64e2b9eb85 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:52.169680 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3dbf038b-fa8e-459f-b392-5f64e2b9eb85 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:52.178393 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3dbf038b-fa8e-459f-b392-5f64e2b9eb85 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.208602 Oct 06 11:05:52.178934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 153/311] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:51 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:52.893871 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:52.894437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:52.902281 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:52.902762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:52.903872 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:52.904694 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:52.905201 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:52.905628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:53.060645 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:53.069838 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:53.071564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:53.072688 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a82004e2-9abb-45e6-ae8d-9d1d0028f2a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1406 microversion: 2.20 time: 0.183728 Oct 06 11:05:53.073244 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 159/312] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:52 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:53.202380 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a701d0f8-90a6-4e2e-82c3-d9bbb5e94a34 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:53.203813 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a701d0f8-90a6-4e2e-82c3-d9bbb5e94a34 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:53.210572 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a701d0f8-90a6-4e2e-82c3-d9bbb5e94a34 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:53.211081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a701d0f8-90a6-4e2e-82c3-d9bbb5e94a34 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:53.211647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a701d0f8-90a6-4e2e-82c3-d9bbb5e94a34 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:53.212658 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a701d0f8-90a6-4e2e-82c3-d9bbb5e94a34 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:53.213301 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a701d0f8-90a6-4e2e-82c3-d9bbb5e94a34 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:53.213841 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a701d0f8-90a6-4e2e-82c3-d9bbb5e94a34 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:53.384072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a701d0f8-90a6-4e2e-82c3-d9bbb5e94a34 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:53.391088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a701d0f8-90a6-4e2e-82c3-d9bbb5e94a34 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.192417 Oct 06 11:05:53.391656 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 154/313] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:53 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:54.099904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:54.100490 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:54.106530 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:54.107017 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:54.107451 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:54.108177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:54.108622 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:54.109037 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:54.242319 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:54.250270 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:54.252232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:54.253373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7647df21-565f-454b-bbd4-2ebd0246d7c4 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1597 microversion: 2.20 time: 0.158614 Oct 06 11:05:54.253933 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 160/314] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:05:54 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:05:54.278642 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf5504c4-17ed-4817-a558-b19c6cd7a10f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:54.279170 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf5504c4-17ed-4817-a558-b19c6cd7a10f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:54.285862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf5504c4-17ed-4817-a558-b19c6cd7a10f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:54.286340 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf5504c4-17ed-4817-a558-b19c6cd7a10f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:54.286774 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf5504c4-17ed-4817-a558-b19c6cd7a10f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:54.287464 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf5504c4-17ed-4817-a558-b19c6cd7a10f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:54.287950 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf5504c4-17ed-4817-a558-b19c6cd7a10f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:54.288373 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf5504c4-17ed-4817-a558-b19c6cd7a10f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:54.362215 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf5504c4-17ed-4817-a558-b19c6cd7a10f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087376 Oct 06 11:05:54.362795 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 155/315] 10.222.0.52 () {60 vars in 1316 bytes} [Thu Oct 6 11:05:54 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 11:05:54.415266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1c06e6b-5fbb-43ef-bb9e-56235942f2c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:54.415986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1c06e6b-5fbb-43ef-bb9e-56235942f2c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:54.422850 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1c06e6b-5fbb-43ef-bb9e-56235942f2c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:54.423719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1c06e6b-5fbb-43ef-bb9e-56235942f2c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:54.425630 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1c06e6b-5fbb-43ef-bb9e-56235942f2c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:54.426441 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1c06e6b-5fbb-43ef-bb9e-56235942f2c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:54.426977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1c06e6b-5fbb-43ef-bb9e-56235942f2c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:54.427622 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1c06e6b-5fbb-43ef-bb9e-56235942f2c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:54.594785 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1c06e6b-5fbb-43ef-bb9e-56235942f2c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:54.602027 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1c06e6b-5fbb-43ef-bb9e-56235942f2c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.191205 Oct 06 11:05:54.602604 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 161/316] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:54 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:05:55.625147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f14af88e-4ab1-43e7-8e73-15ac9faf498d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:55.625753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f14af88e-4ab1-43e7-8e73-15ac9faf498d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:55.633184 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f14af88e-4ab1-43e7-8e73-15ac9faf498d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:55.633676 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f14af88e-4ab1-43e7-8e73-15ac9faf498d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:55.634110 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f14af88e-4ab1-43e7-8e73-15ac9faf498d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:55.635578 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f14af88e-4ab1-43e7-8e73-15ac9faf498d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:55.636606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f14af88e-4ab1-43e7-8e73-15ac9faf498d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:55.637567 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f14af88e-4ab1-43e7-8e73-15ac9faf498d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:55.861738 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f14af88e-4ab1-43e7-8e73-15ac9faf498d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:55.870078 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f14af88e-4ab1-43e7-8e73-15ac9faf498d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.248654 Oct 06 11:05:55.870878 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 156/317] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:55 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:55.887996 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-720a77bb-9a60-4a9d-9f21-aa1c2c2a6807 req-29769e28-6e24-4ea1-8543-c5c2f8021ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9fceeb-0987-4e4f-b34b-f524fa791d3b", "tag": "e16aada9-7c39-402c-9979-d8f302e4c39a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:05:55.905969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-720a77bb-9a60-4a9d-9f21-aa1c2c2a6807 req-29769e28-6e24-4ea1-8543-c5c2f8021ac8 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:55.906636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-720a77bb-9a60-4a9d-9f21-aa1c2c2a6807 req-29769e28-6e24-4ea1-8543-c5c2f8021ac8 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:55.907098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-720a77bb-9a60-4a9d-9f21-aa1c2c2a6807 req-29769e28-6e24-4ea1-8543-c5c2f8021ac8 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:56.065317 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-720a77bb-9a60-4a9d-9f21-aa1c2c2a6807 req-29769e28-6e24-4ea1-8543-c5c2f8021ac8 service nova] Creating event network-changed:e16aada9-7c39-402c-9979-d8f302e4c39a for instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b on hv-cinder-86020 Oct 06 11:05:56.070722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-720a77bb-9a60-4a9d-9f21-aa1c2c2a6807 req-29769e28-6e24-4ea1-8543-c5c2f8021ac8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189919 Oct 06 11:05:56.071598 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 162/318] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:05:56.895291 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6bb3520d-9b3f-4806-a817-badd967cf92c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:56.895906 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6bb3520d-9b3f-4806-a817-badd967cf92c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:56.902780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb3520d-9b3f-4806-a817-badd967cf92c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:56.903391 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb3520d-9b3f-4806-a817-badd967cf92c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:56.903826 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb3520d-9b3f-4806-a817-badd967cf92c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:56.904545 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb3520d-9b3f-4806-a817-badd967cf92c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:56.904996 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb3520d-9b3f-4806-a817-badd967cf92c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:56.905420 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb3520d-9b3f-4806-a817-badd967cf92c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:57.041085 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6bb3520d-9b3f-4806-a817-badd967cf92c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:57.049042 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6bb3520d-9b3f-4806-a817-badd967cf92c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.158258 Oct 06 11:05:57.049805 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 157/319] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:56 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:58.073338 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d314462b-6284-4589-a0d6-824a4b8aed23 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:58.074075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d314462b-6284-4589-a0d6-824a4b8aed23 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:58.080723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d314462b-6284-4589-a0d6-824a4b8aed23 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:58.081199 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d314462b-6284-4589-a0d6-824a4b8aed23 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:58.081628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d314462b-6284-4589-a0d6-824a4b8aed23 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:58.082308 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d314462b-6284-4589-a0d6-824a4b8aed23 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:58.082773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d314462b-6284-4589-a0d6-824a4b8aed23 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:58.083172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d314462b-6284-4589-a0d6-824a4b8aed23 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:58.209852 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d314462b-6284-4589-a0d6-824a4b8aed23 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:58.217383 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d314462b-6284-4589-a0d6-824a4b8aed23 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.148810 Oct 06 11:05:58.217938 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 163/320] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:58 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:05:59.240537 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7bf5deba-aa02-4c4f-b96f-b35f6fd1e161 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:05:59.241154 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7bf5deba-aa02-4c4f-b96f-b35f6fd1e161 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:05:59.247208 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bf5deba-aa02-4c4f-b96f-b35f6fd1e161 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:59.247692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bf5deba-aa02-4c4f-b96f-b35f6fd1e161 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:59.248170 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bf5deba-aa02-4c4f-b96f-b35f6fd1e161 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:59.248862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bf5deba-aa02-4c4f-b96f-b35f6fd1e161 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:05:59.249316 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bf5deba-aa02-4c4f-b96f-b35f6fd1e161 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:05:59.249742 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bf5deba-aa02-4c4f-b96f-b35f6fd1e161 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:05:59.376122 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7bf5deba-aa02-4c4f-b96f-b35f6fd1e161 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:05:59.383686 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7bf5deba-aa02-4c4f-b96f-b35f6fd1e161 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.146995 Oct 06 11:05:59.384293 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 158/321] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:05:59 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:00.406652 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-70ab7ed6-9185-4a1a-ae06-fedbdadf5046 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:00.407378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-70ab7ed6-9185-4a1a-ae06-fedbdadf5046 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:00.410666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=69 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:00.416186 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ab7ed6-9185-4a1a-ae06-fedbdadf5046 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:00.416676 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ab7ed6-9185-4a1a-ae06-fedbdadf5046 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:00.417118 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ab7ed6-9185-4a1a-ae06-fedbdadf5046 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:00.417819 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ab7ed6-9185-4a1a-ae06-fedbdadf5046 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:00.418277 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ab7ed6-9185-4a1a-ae06-fedbdadf5046 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:00.418706 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ab7ed6-9185-4a1a-ae06-fedbdadf5046 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:00.557127 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-70ab7ed6-9185-4a1a-ae06-fedbdadf5046 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:00.565290 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-70ab7ed6-9185-4a1a-ae06-fedbdadf5046 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.162628 Oct 06 11:06:00.565856 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 164/322] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:00 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:01.587619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-debe3b4d-c2b7-4d06-a588-27467e4ed5c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:01.588295 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-debe3b4d-c2b7-4d06-a588-27467e4ed5c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:01.594113 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-debe3b4d-c2b7-4d06-a588-27467e4ed5c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:01.594691 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-debe3b4d-c2b7-4d06-a588-27467e4ed5c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:01.595159 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-debe3b4d-c2b7-4d06-a588-27467e4ed5c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:01.595954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-debe3b4d-c2b7-4d06-a588-27467e4ed5c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:01.596488 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-debe3b4d-c2b7-4d06-a588-27467e4ed5c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:01.596976 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-debe3b4d-c2b7-4d06-a588-27467e4ed5c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:01.736487 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-debe3b4d-c2b7-4d06-a588-27467e4ed5c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:01.745282 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-debe3b4d-c2b7-4d06-a588-27467e4ed5c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.161642 Oct 06 11:06:01.761437 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 159/323] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:01 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:02.769154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1d400287-8687-4a4e-8ce2-2c7337ae721c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:02.769783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1d400287-8687-4a4e-8ce2-2c7337ae721c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:02.778942 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d400287-8687-4a4e-8ce2-2c7337ae721c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:02.779438 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d400287-8687-4a4e-8ce2-2c7337ae721c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:02.779900 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d400287-8687-4a4e-8ce2-2c7337ae721c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:02.780932 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d400287-8687-4a4e-8ce2-2c7337ae721c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:02.782865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d400287-8687-4a4e-8ce2-2c7337ae721c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:02.783321 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d400287-8687-4a4e-8ce2-2c7337ae721c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:02.944480 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d400287-8687-4a4e-8ce2-2c7337ae721c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:02.955143 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1d400287-8687-4a4e-8ce2-2c7337ae721c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.188059 Oct 06 11:06:02.955143 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 165/324] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:02 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:03.792869 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fbc59a88-a42b-4b8b-b7c7-bbe0a56647d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:03.794031 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fbc59a88-a42b-4b8b-b7c7-bbe0a56647d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:03.800996 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbc59a88-a42b-4b8b-b7c7-bbe0a56647d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:03.801490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbc59a88-a42b-4b8b-b7c7-bbe0a56647d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:03.801931 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbc59a88-a42b-4b8b-b7c7-bbe0a56647d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:03.802643 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbc59a88-a42b-4b8b-b7c7-bbe0a56647d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:03.803098 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbc59a88-a42b-4b8b-b7c7-bbe0a56647d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:03.803955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbc59a88-a42b-4b8b-b7c7-bbe0a56647d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:03.832347 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fbc59a88-a42b-4b8b-b7c7-bbe0a56647d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:06:03.953177 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fbc59a88-a42b-4b8b-b7c7-bbe0a56647d4 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 204 len: 0 microversion: 2.1 time: 0.165204 Oct 06 11:06:03.954140 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 160/325] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:06:03 2022] DELETE /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:06:03.962267 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e0016c4-0db0-4b74-bf79-fa654565805b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:03.962884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e0016c4-0db0-4b74-bf79-fa654565805b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:03.969228 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e0016c4-0db0-4b74-bf79-fa654565805b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:03.969770 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e0016c4-0db0-4b74-bf79-fa654565805b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:03.970212 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e0016c4-0db0-4b74-bf79-fa654565805b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:03.972369 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e0016c4-0db0-4b74-bf79-fa654565805b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:03.973004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e0016c4-0db0-4b74-bf79-fa654565805b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:03.973651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e0016c4-0db0-4b74-bf79-fa654565805b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:03.980264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abcb8b76-c3b2-4044-ae4e-b20ea8e1061a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:03.981527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abcb8b76-c3b2-4044-ae4e-b20ea8e1061a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:03.998001 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb8b76-c3b2-4044-ae4e-b20ea8e1061a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:03.999268 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb8b76-c3b2-4044-ae4e-b20ea8e1061a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:04.000404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb8b76-c3b2-4044-ae4e-b20ea8e1061a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:04.003130 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb8b76-c3b2-4044-ae4e-b20ea8e1061a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:04.003620 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb8b76-c3b2-4044-ae4e-b20ea8e1061a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:04.004436 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb8b76-c3b2-4044-ae4e-b20ea8e1061a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:04.173575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e0016c4-0db0-4b74-bf79-fa654565805b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:04.182374 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e0016c4-0db0-4b74-bf79-fa654565805b tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1552 microversion: 2.1 time: 0.223679 Oct 06 11:06:04.199460 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 166/326] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:03 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1552 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:04.385017 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-abcb8b76-c3b2-4044-ae4e-b20ea8e1061a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:04.418064 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abcb8b76-c3b2-4044-ae4e-b20ea8e1061a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.445059 Oct 06 11:06:04.418764 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 161/327] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:03 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:05.211666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8635e489-a013-40d6-ba4c-663268f3a087 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:05.212326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8635e489-a013-40d6-ba4c-663268f3a087 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:05.218540 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8635e489-a013-40d6-ba4c-663268f3a087 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:05.219166 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8635e489-a013-40d6-ba4c-663268f3a087 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:05.219661 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8635e489-a013-40d6-ba4c-663268f3a087 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:05.220439 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8635e489-a013-40d6-ba4c-663268f3a087 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:05.221022 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8635e489-a013-40d6-ba4c-663268f3a087 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:05.221663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8635e489-a013-40d6-ba4c-663268f3a087 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:05.381480 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8635e489-a013-40d6-ba4c-663268f3a087 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:05.398048 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8635e489-a013-40d6-ba4c-663268f3a087 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1552 microversion: 2.1 time: 0.190132 Oct 06 11:06:05.398900 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 167/328] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:05 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1552 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:05.446471 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0a153a0e-de75-4e68-a378-da152890033b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:05.447707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0a153a0e-de75-4e68-a378-da152890033b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:05.455101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a153a0e-de75-4e68-a378-da152890033b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:05.456209 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a153a0e-de75-4e68-a378-da152890033b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:05.456922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a153a0e-de75-4e68-a378-da152890033b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:05.458442 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a153a0e-de75-4e68-a378-da152890033b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:05.459194 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a153a0e-de75-4e68-a378-da152890033b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:05.459805 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a153a0e-de75-4e68-a378-da152890033b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:05.604451 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0a153a0e-de75-4e68-a378-da152890033b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:05.621947 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0a153a0e-de75-4e68-a378-da152890033b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.182079 Oct 06 11:06:05.623372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 162/329] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:05 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:06.420991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a620b11b-f9fd-4580-a228-f42c1377e70d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:06.421890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a620b11b-f9fd-4580-a228-f42c1377e70d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:06.428778 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a620b11b-f9fd-4580-a228-f42c1377e70d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:06.429365 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a620b11b-f9fd-4580-a228-f42c1377e70d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:06.429898 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a620b11b-f9fd-4580-a228-f42c1377e70d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:06.431033 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a620b11b-f9fd-4580-a228-f42c1377e70d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:06.431254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a620b11b-f9fd-4580-a228-f42c1377e70d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:06.431782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a620b11b-f9fd-4580-a228-f42c1377e70d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:06.648594 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-220bb7db-44f4-4cd2-b3d0-51879f213142 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:06.649828 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-220bb7db-44f4-4cd2-b3d0-51879f213142 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:06.655992 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220bb7db-44f4-4cd2-b3d0-51879f213142 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:06.656492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220bb7db-44f4-4cd2-b3d0-51879f213142 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:06.656930 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220bb7db-44f4-4cd2-b3d0-51879f213142 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:06.657981 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220bb7db-44f4-4cd2-b3d0-51879f213142 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:06.658527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220bb7db-44f4-4cd2-b3d0-51879f213142 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:06.658960 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-220bb7db-44f4-4cd2-b3d0-51879f213142 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:06.689839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a620b11b-f9fd-4580-a228-f42c1377e70d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:06.698325 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a620b11b-f9fd-4580-a228-f42c1377e70d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1552 microversion: 2.1 time: 0.281151 Oct 06 11:06:06.699064 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 168/330] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:06 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1552 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:06.831584 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-220bb7db-44f4-4cd2-b3d0-51879f213142 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:06.835236 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:06.840443 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-220bb7db-44f4-4cd2-b3d0-51879f213142 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.196891 Oct 06 11:06:06.841007 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 163/331] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:06 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:06:07.692220 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d55c0292-1665-4114-9fff-f13a3a7e242a req-3f398354-6358-4b9f-ac78-29b756a3425c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de15d8c-124c-4827-839a-89d209f344e8", "name": "network-vif-deleted", "tag": "3dad21ae-1cb8-4cb8-b40b-12d49df819af"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:06:07.702231 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d55c0292-1665-4114-9fff-f13a3a7e242a req-3f398354-6358-4b9f-ac78-29b756a3425c service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:07.702705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d55c0292-1665-4114-9fff-f13a3a7e242a req-3f398354-6358-4b9f-ac78-29b756a3425c service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:07.703129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d55c0292-1665-4114-9fff-f13a3a7e242a req-3f398354-6358-4b9f-ac78-29b756a3425c service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:07.707780 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:07.715752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d55c0292-1665-4114-9fff-f13a3a7e242a req-3f398354-6358-4b9f-ac78-29b756a3425c service nova] Creating event network-vif-deleted:3dad21ae-1cb8-4cb8-b40b-12d49df819af for instance 9de15d8c-124c-4827-839a-89d209f344e8 on hv-cinder-86020 Oct 06 11:06:07.722058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d55c0292-1665-4114-9fff-f13a3a7e242a req-3f398354-6358-4b9f-ac78-29b756a3425c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033538 Oct 06 11:06:07.722890 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c69802f0-672d-472f-95b2-608cabfc8cf9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:07.723376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 169/332] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:06:07.724243 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c69802f0-672d-472f-95b2-608cabfc8cf9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:07.727940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:07.734529 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c69802f0-672d-472f-95b2-608cabfc8cf9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:07.735031 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c69802f0-672d-472f-95b2-608cabfc8cf9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:07.735475 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c69802f0-672d-472f-95b2-608cabfc8cf9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:07.736811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c69802f0-672d-472f-95b2-608cabfc8cf9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:07.737387 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c69802f0-672d-472f-95b2-608cabfc8cf9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:07.737830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c69802f0-672d-472f-95b2-608cabfc8cf9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:07.804816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c69802f0-672d-472f-95b2-608cabfc8cf9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:07.813095 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c69802f0-672d-472f-95b2-608cabfc8cf9 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1510 microversion: 2.1 time: 0.094911 Oct 06 11:06:07.813655 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 164/333] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:07 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1510 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:06:07.863664 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89dbd64f-a930-4af8-9c2d-b2c0230912ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:07.864388 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-89dbd64f-a930-4af8-9c2d-b2c0230912ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:07.871490 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89dbd64f-a930-4af8-9c2d-b2c0230912ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:07.872000 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89dbd64f-a930-4af8-9c2d-b2c0230912ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:07.872440 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89dbd64f-a930-4af8-9c2d-b2c0230912ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:07.873126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89dbd64f-a930-4af8-9c2d-b2c0230912ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:07.873583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89dbd64f-a930-4af8-9c2d-b2c0230912ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:07.874005 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89dbd64f-a930-4af8-9c2d-b2c0230912ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:08.005885 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-89dbd64f-a930-4af8-9c2d-b2c0230912ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:08.013521 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-89dbd64f-a930-4af8-9c2d-b2c0230912ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.154795 Oct 06 11:06:08.014087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 170/334] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:07 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:08.837514 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34394a00-829a-4110-9d30-245a591d3add tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:08.838046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-34394a00-829a-4110-9d30-245a591d3add tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:08.843890 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34394a00-829a-4110-9d30-245a591d3add tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:08.844376 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34394a00-829a-4110-9d30-245a591d3add tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:08.844814 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34394a00-829a-4110-9d30-245a591d3add tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:08.845494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34394a00-829a-4110-9d30-245a591d3add tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:08.846040 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34394a00-829a-4110-9d30-245a591d3add tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:08.846454 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34394a00-829a-4110-9d30-245a591d3add tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:08.906859 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-34394a00-829a-4110-9d30-245a591d3add tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:08.914999 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-34394a00-829a-4110-9d30-245a591d3add tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1510 microversion: 2.1 time: 0.081440 Oct 06 11:06:08.915548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 165/335] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:08 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1510 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:09.037086 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-80690848-d246-4f60-8d7c-7b4ebd1c16e7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:09.037697 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80690848-d246-4f60-8d7c-7b4ebd1c16e7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:09.044078 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80690848-d246-4f60-8d7c-7b4ebd1c16e7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:09.044567 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80690848-d246-4f60-8d7c-7b4ebd1c16e7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:09.045009 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80690848-d246-4f60-8d7c-7b4ebd1c16e7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:09.045702 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80690848-d246-4f60-8d7c-7b4ebd1c16e7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:09.046158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80690848-d246-4f60-8d7c-7b4ebd1c16e7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:09.046586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80690848-d246-4f60-8d7c-7b4ebd1c16e7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:09.173298 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-80690848-d246-4f60-8d7c-7b4ebd1c16e7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:09.181571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-80690848-d246-4f60-8d7c-7b4ebd1c16e7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.148516 Oct 06 11:06:09.182137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 171/336] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:09 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:09.938230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-976082d1-6531-4114-ad56-d1c96f1d8eb3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:09.938760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-976082d1-6531-4114-ad56-d1c96f1d8eb3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:09.944881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-976082d1-6531-4114-ad56-d1c96f1d8eb3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:09.945363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-976082d1-6531-4114-ad56-d1c96f1d8eb3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:09.945799 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-976082d1-6531-4114-ad56-d1c96f1d8eb3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:09.946478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-976082d1-6531-4114-ad56-d1c96f1d8eb3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:09.946931 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-976082d1-6531-4114-ad56-d1c96f1d8eb3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:09.947351 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-976082d1-6531-4114-ad56-d1c96f1d8eb3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:10.007286 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-976082d1-6531-4114-ad56-d1c96f1d8eb3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:10.015281 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-976082d1-6531-4114-ad56-d1c96f1d8eb3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1510 microversion: 2.1 time: 0.080995 Oct 06 11:06:10.015853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 166/337] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:09 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1510 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:10.206107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-72627201-4509-4220-82f2-5ca34ed18b9d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:10.206684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-72627201-4509-4220-82f2-5ca34ed18b9d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:10.213021 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72627201-4509-4220-82f2-5ca34ed18b9d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:10.213495 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72627201-4509-4220-82f2-5ca34ed18b9d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:10.213995 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72627201-4509-4220-82f2-5ca34ed18b9d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:10.214676 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72627201-4509-4220-82f2-5ca34ed18b9d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:10.215123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72627201-4509-4220-82f2-5ca34ed18b9d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:10.215539 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72627201-4509-4220-82f2-5ca34ed18b9d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:10.417837 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-72627201-4509-4220-82f2-5ca34ed18b9d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:10.426307 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-72627201-4509-4220-82f2-5ca34ed18b9d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.224794 Oct 06 11:06:10.426874 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 172/338] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:10 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:11.039084 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c5190de-c753-4705-a906-07e5938d0aae tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:11.039693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c5190de-c753-4705-a906-07e5938d0aae tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:11.045538 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c5190de-c753-4705-a906-07e5938d0aae tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:11.046014 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c5190de-c753-4705-a906-07e5938d0aae tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:11.046444 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c5190de-c753-4705-a906-07e5938d0aae tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:11.047121 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c5190de-c753-4705-a906-07e5938d0aae tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:11.047576 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c5190de-c753-4705-a906-07e5938d0aae tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:11.048025 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c5190de-c753-4705-a906-07e5938d0aae tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:11.111828 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c5190de-c753-4705-a906-07e5938d0aae tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:11.120213 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c5190de-c753-4705-a906-07e5938d0aae tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1510 microversion: 2.1 time: 0.084881 Oct 06 11:06:11.120779 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 167/339] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:11 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:11.448438 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-78a3dae5-339f-4615-a678-3172552479c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:11.449056 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-78a3dae5-339f-4615-a678-3172552479c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:11.455437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78a3dae5-339f-4615-a678-3172552479c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:11.455957 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78a3dae5-339f-4615-a678-3172552479c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:11.456404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78a3dae5-339f-4615-a678-3172552479c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:11.457099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78a3dae5-339f-4615-a678-3172552479c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:11.457558 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78a3dae5-339f-4615-a678-3172552479c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:11.457982 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78a3dae5-339f-4615-a678-3172552479c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:11.588517 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-78a3dae5-339f-4615-a678-3172552479c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:11.596883 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-78a3dae5-339f-4615-a678-3172552479c5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.152190 Oct 06 11:06:11.597443 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 173/340] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:11 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:12.142374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc5cc638-2191-411f-bd56-5c2e8783649d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:12.143606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc5cc638-2191-411f-bd56-5c2e8783649d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:12.150100 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc5cc638-2191-411f-bd56-5c2e8783649d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:12.150584 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc5cc638-2191-411f-bd56-5c2e8783649d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:12.151016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc5cc638-2191-411f-bd56-5c2e8783649d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:12.151704 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc5cc638-2191-411f-bd56-5c2e8783649d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:12.152187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc5cc638-2191-411f-bd56-5c2e8783649d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:12.152606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc5cc638-2191-411f-bd56-5c2e8783649d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:12.214578 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc5cc638-2191-411f-bd56-5c2e8783649d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:12.224399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc5cc638-2191-411f-bd56-5c2e8783649d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1345 microversion: 2.1 time: 0.085397 Oct 06 11:06:12.224670 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 168/341] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:12 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:12.619557 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-251bd3af-1b52-4b04-9244-87ac8a939af2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:12.620080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-251bd3af-1b52-4b04-9244-87ac8a939af2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:12.626496 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251bd3af-1b52-4b04-9244-87ac8a939af2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:12.627016 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251bd3af-1b52-4b04-9244-87ac8a939af2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:12.627446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251bd3af-1b52-4b04-9244-87ac8a939af2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:12.628166 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251bd3af-1b52-4b04-9244-87ac8a939af2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:12.628616 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251bd3af-1b52-4b04-9244-87ac8a939af2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:12.629033 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251bd3af-1b52-4b04-9244-87ac8a939af2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:12.761702 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-251bd3af-1b52-4b04-9244-87ac8a939af2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:12.769837 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-251bd3af-1b52-4b04-9244-87ac8a939af2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.154103 Oct 06 11:06:12.770400 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 174/342] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:12 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:13.247340 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2151a2d5-2165-4d70-9d4a-2c277983af44 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:13.248005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2151a2d5-2165-4d70-9d4a-2c277983af44 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:13.255162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2151a2d5-2165-4d70-9d4a-2c277983af44 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:13.255657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2151a2d5-2165-4d70-9d4a-2c277983af44 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:13.256136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2151a2d5-2165-4d70-9d4a-2c277983af44 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:13.256836 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2151a2d5-2165-4d70-9d4a-2c277983af44 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:13.257300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2151a2d5-2165-4d70-9d4a-2c277983af44 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:13.257735 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2151a2d5-2165-4d70-9d4a-2c277983af44 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:13.317964 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2151a2d5-2165-4d70-9d4a-2c277983af44 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:13.326103 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2151a2d5-2165-4d70-9d4a-2c277983af44 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1345 microversion: 2.1 time: 0.082635 Oct 06 11:06:13.326663 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 169/343] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:13 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:13.793012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a35ee40-886b-4e39-8be4-4033e471e29e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:13.794501 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a35ee40-886b-4e39-8be4-4033e471e29e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:13.800791 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a35ee40-886b-4e39-8be4-4033e471e29e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:13.801283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a35ee40-886b-4e39-8be4-4033e471e29e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:13.801722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a35ee40-886b-4e39-8be4-4033e471e29e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:13.802421 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a35ee40-886b-4e39-8be4-4033e471e29e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:13.802880 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a35ee40-886b-4e39-8be4-4033e471e29e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:13.803306 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a35ee40-886b-4e39-8be4-4033e471e29e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:13.938890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a35ee40-886b-4e39-8be4-4033e471e29e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:13.946693 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a35ee40-886b-4e39-8be4-4033e471e29e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.158072 Oct 06 11:06:13.947260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 175/344] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:13 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:14.349428 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d1c35f2-80b4-4991-b2cf-d0040db9c8eb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:14.350181 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d1c35f2-80b4-4991-b2cf-d0040db9c8eb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:14.357940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1c35f2-80b4-4991-b2cf-d0040db9c8eb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:14.358477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1c35f2-80b4-4991-b2cf-d0040db9c8eb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:14.358959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1c35f2-80b4-4991-b2cf-d0040db9c8eb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:14.359868 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1c35f2-80b4-4991-b2cf-d0040db9c8eb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:14.360630 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1c35f2-80b4-4991-b2cf-d0040db9c8eb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:14.361134 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1c35f2-80b4-4991-b2cf-d0040db9c8eb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:14.437747 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d1c35f2-80b4-4991-b2cf-d0040db9c8eb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:14.446620 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d1c35f2-80b4-4991-b2cf-d0040db9c8eb tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1345 microversion: 2.1 time: 0.101480 Oct 06 11:06:14.447210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 170/345] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:14 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:14.970032 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33149391-cb25-4871-9df5-f6a73e74e712 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:14.970870 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33149391-cb25-4871-9df5-f6a73e74e712 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:14.978002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33149391-cb25-4871-9df5-f6a73e74e712 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:14.978490 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33149391-cb25-4871-9df5-f6a73e74e712 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:14.978923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33149391-cb25-4871-9df5-f6a73e74e712 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:14.980225 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33149391-cb25-4871-9df5-f6a73e74e712 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:14.980403 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33149391-cb25-4871-9df5-f6a73e74e712 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:14.980827 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33149391-cb25-4871-9df5-f6a73e74e712 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:15.125787 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-33149391-cb25-4871-9df5-f6a73e74e712 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:15.134369 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-33149391-cb25-4871-9df5-f6a73e74e712 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.168548 Oct 06 11:06:15.148416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 176/346] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:14 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:15.470450 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:15.471627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:15.477901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:15.478406 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:15.478851 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:15.479567 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:15.480062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:15.480503 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:15.515219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:15.515730 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:15.516203 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:15.516666 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lazy-loading 'fault' on Instance uuid 9de15d8c-124c-4827-839a-89d209f344e8 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:06:15.575593 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:15.585749 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6b4e320-0831-4090-b104-bd84a957b9b0 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1350 microversion: 2.1 time: 0.119951 Oct 06 11:06:15.587581 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 171/347] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:15 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:16.158308 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-365297b0-790e-4641-a3a6-25f0ff866d48 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:16.158901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-365297b0-790e-4641-a3a6-25f0ff866d48 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:16.165650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-365297b0-790e-4641-a3a6-25f0ff866d48 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:16.166146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-365297b0-790e-4641-a3a6-25f0ff866d48 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:16.166583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-365297b0-790e-4641-a3a6-25f0ff866d48 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:16.167281 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-365297b0-790e-4641-a3a6-25f0ff866d48 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:16.167737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-365297b0-790e-4641-a3a6-25f0ff866d48 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:16.168211 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-365297b0-790e-4641-a3a6-25f0ff866d48 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:16.306060 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-365297b0-790e-4641-a3a6-25f0ff866d48 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:16.317100 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-365297b0-790e-4641-a3a6-25f0ff866d48 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1522 microversion: 2.1 time: 0.159289 Oct 06 11:06:16.317100 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 177/348] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:16 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:16.610913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:16.612460 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:16.619132 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:16.619881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:16.620452 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:16.621405 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:16.621949 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:16.622486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:16.661548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:16.662212 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:16.662648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:16.663125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lazy-loading 'fault' on Instance uuid 9de15d8c-124c-4827-839a-89d209f344e8 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:06:16.713440 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02930aebe31e450f9fc989af369bf319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa6c50978eb46ecba4c88562ede965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:16.736021 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac4e0f55-e7c7-4ac1-815c-2458047aee8e tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 200 len: 1350 microversion: 2.1 time: 0.116942 Oct 06 11:06:16.736021 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 172/349] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:16 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 1350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:06:17.336015 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fb51272f-f93b-40ae-bdb5-57091f75944a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:17.336551 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fb51272f-f93b-40ae-bdb5-57091f75944a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:17.342941 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb51272f-f93b-40ae-bdb5-57091f75944a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:17.343437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb51272f-f93b-40ae-bdb5-57091f75944a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:17.343897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb51272f-f93b-40ae-bdb5-57091f75944a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:17.344594 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb51272f-f93b-40ae-bdb5-57091f75944a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:17.345052 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb51272f-f93b-40ae-bdb5-57091f75944a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:17.345976 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb51272f-f93b-40ae-bdb5-57091f75944a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:17.474695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-fb51272f-f93b-40ae-bdb5-57091f75944a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:17.482300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fb51272f-f93b-40ae-bdb5-57091f75944a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1502 microversion: 2.1 time: 0.150379 Oct 06 11:06:17.482863 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 178/350] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:17 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:17.504008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dccdc293-5d2f-4d69-887a-e58d23b86cb0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:17.504634 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dccdc293-5d2f-4d69-887a-e58d23b86cb0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:17.510346 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccdc293-5d2f-4d69-887a-e58d23b86cb0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:17.511007 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccdc293-5d2f-4d69-887a-e58d23b86cb0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:17.511263 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccdc293-5d2f-4d69-887a-e58d23b86cb0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:17.511978 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccdc293-5d2f-4d69-887a-e58d23b86cb0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:17.512435 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccdc293-5d2f-4d69-887a-e58d23b86cb0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:17.512858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccdc293-5d2f-4d69-887a-e58d23b86cb0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:17.640567 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dccdc293-5d2f-4d69-887a-e58d23b86cb0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:17.649047 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dccdc293-5d2f-4d69-887a-e58d23b86cb0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1516 microversion: 2.1 time: 0.148846 Oct 06 11:06:17.649610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 173/351] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:17 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:17.746455 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:17.747159 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:17.753259 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:17.753835 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:17.754358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:17.755121 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:17.755666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:17.756188 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:17.770069 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] HTTP exception thrown: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Request method failure captured: Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 HTTP/1.1 Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYviAWKIeKKpskYa6K9C0oI_GpmHCcmBjYotkHeex_pOCQ3x_1BQpw1AB2JsONxwWOnjWUpJQhgFWqoO7hvhgg-iKT-eGeBkAn0rmemMSR9B-Yrj08LuMkTBg0l-0Uwl6yh5oU-cNNCsTqlYARMuC6u6wjMwdOei-5jp7jyZ02YfRQ Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: aaa6c50978eb46ecba4c88562ede965b Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:06:17.780047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: aaa6c50978eb46ecba4c88562ede965b Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-238294905-project Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 02930aebe31e450f9fc989af369bf319 Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-238294905-project Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:17.781527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '9de15d8c-124c-4827-839a-89d209f344e8'} Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:06:17.782246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:17.784203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:17.785263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Returning 404 to user: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:06:17.785263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eceb984d-5871-479f-8e2e-c53ad26667d3 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 404 len: 111 microversion: 2.1 time: 0.038875 Oct 06 11:06:17.785263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 179/352] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:17 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:06:17.937414 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:17.940401 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:17.946324 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:17.946804 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:17.947284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:17.948182 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:17.948831 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:17.949265 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:17.963431 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] HTTP exception thrown: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Request method failure captured: Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8/os-volume_attachments HTTP/1.1 Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrYviAWKIeKKpskYa6K9C0oI_GpmHCcmBjYotkHeex_pOCQ3x_1BQpw1AB2JsONxwWOnjWUpJQhgFWqoO7hvhgg-iKT-eGeBkAn0rmemMSR9B-Yrj08LuMkTBg0l-0Uwl6yh5oU-cNNCsTqlYARMuC6u6wjMwdOei-5jp7jyZ02YfRQ Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: aaa6c50978eb46ecba4c88562ede965b Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:06:17.973609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: aaa6c50978eb46ecba4c88562ede965b Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-238294905-project Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 02930aebe31e450f9fc989af369bf319 Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-238294905-project Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:17.975075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'server_id': '9de15d8c-124c-4827-839a-89d209f344e8'} Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:06:17.976079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:17.978582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:06:17.980785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Returning 404 to user: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:06:17.980785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e73aa05-541d-415c-b82a-7011f9f7c88d tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041807 Oct 06 11:06:17.980785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 174/353] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:06:17 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:06:20.105941 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0622de8-4cae-4460-b50c-4281f5dcc79a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:06:20.108202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0622de8-4cae-4460-b50c-4281f5dcc79a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:20.115394 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0622de8-4cae-4460-b50c-4281f5dcc79a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:20.115910 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0622de8-4cae-4460-b50c-4281f5dcc79a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:20.116356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0622de8-4cae-4460-b50c-4281f5dcc79a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:20.117057 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0622de8-4cae-4460-b50c-4281f5dcc79a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:20.117522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0622de8-4cae-4460-b50c-4281f5dcc79a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:20.117952 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0622de8-4cae-4460-b50c-4281f5dcc79a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:20.140256 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-c0622de8-4cae-4460-b50c-4281f5dcc79a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lazy-loading 'flavor' on Instance uuid 41685b83-a75b-4abc-814c-c9a4424f2c65 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:06:20.253416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0622de8-4cae-4460-b50c-4281f5dcc79a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65/action" status: 200 len: 32 microversion: 2.1 time: 0.151328 Oct 06 11:06:20.254121 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 180/354] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:06:20 2022] POST /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 11:06:20.263605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51a594c8-53a9-40f3-8f55-29331fa79f7f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:20.264824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-51a594c8-53a9-40f3-8f55-29331fa79f7f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:20.273210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51a594c8-53a9-40f3-8f55-29331fa79f7f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:20.273709 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51a594c8-53a9-40f3-8f55-29331fa79f7f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:20.274144 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51a594c8-53a9-40f3-8f55-29331fa79f7f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:20.274918 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51a594c8-53a9-40f3-8f55-29331fa79f7f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:20.277194 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51a594c8-53a9-40f3-8f55-29331fa79f7f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:20.277683 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51a594c8-53a9-40f3-8f55-29331fa79f7f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:20.301733 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:20.302237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:20.308967 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:20.309442 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:20.310050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:20.310749 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:20.311200 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:20.311616 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:20.325821 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] HTTP exception thrown: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Request method failure captured: Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 HTTP/1.1 Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYviAWKIeKKpskYa6K9C0oI_GpmHCcmBjYotkHeex_pOCQ3x_1BQpw1AB2JsONxwWOnjWUpJQhgFWqoO7hvhgg-iKT-eGeBkAn0rmemMSR9B-Yrj08LuMkTBg0l-0Uwl6yh5oU-cNNCsTqlYARMuC6u6wjMwdOei-5jp7jyZ02YfRQ Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: aaa6c50978eb46ecba4c88562ede965b Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:06:20.327809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: aaa6c50978eb46ecba4c88562ede965b Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-238294905-project Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 02930aebe31e450f9fc989af369bf319 Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-238294905-project Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:20.329890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '9de15d8c-124c-4827-839a-89d209f344e8'} Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:06:20.330884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:20.347462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:20.348914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Returning 404 to user: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:06:20.348914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-03271150-e315-4c70-8ec3-9cb29d3d7dac tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 404 len: 111 microversion: 2.1 time: 0.032448 Oct 06 11:06:20.348914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 181/355] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:06:20 2022] DELETE /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 11:06:20.350087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:20.350708 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] [instance: 9de15d8c-124c-4827-839a-89d209f344e8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:20.356884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:20.357380 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:20.358260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:20.358632 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:20.358968 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:20.359392 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:20.374435 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] HTTP exception thrown: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Request method failure captured: Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 HTTP/1.1 Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYviAWKIeKKpskYa6K9C0oI_GpmHCcmBjYotkHeex_pOCQ3x_1BQpw1AB2JsONxwWOnjWUpJQhgFWqoO7hvhgg-iKT-eGeBkAn0rmemMSR9B-Yrj08LuMkTBg0l-0Uwl6yh5oU-cNNCsTqlYARMuC6u6wjMwdOei-5jp7jyZ02YfRQ Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: aaa6c50978eb46ecba4c88562ede965b Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:06:20.376014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aaa6c50978eb46ecba4c88562ede965b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: aaa6c50978eb46ecba4c88562ede965b Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-238294905 Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-238294905-project Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 02930aebe31e450f9fc989af369bf319 Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-238294905-project Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:20.377578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '9de15d8c-124c-4827-839a-89d209f344e8'} Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:06:20.378355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. Oct 06 11:06:20.379430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:20.380437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] Returning 404 to user: Instance 9de15d8c-124c-4827-839a-89d209f344e8 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:06:20.380437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dfd88c04-6bad-4808-890f-603da3b5b679 tempest-DeleteServersTestJSON-238294905 tempest-DeleteServersTestJSON-238294905-project] 10.222.0.52 "GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8" status: 404 len: 111 microversion: 2.1 time: 0.043429 Oct 06 11:06:20.380437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 182/356] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:20 2022] GET /compute/v2.1/servers/9de15d8c-124c-4827-839a-89d209f344e8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:06:20.750196 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-51a594c8-53a9-40f3-8f55-29331fa79f7f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:20.759252 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-51a594c8-53a9-40f3-8f55-29331fa79f7f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.499401 Oct 06 11:06:20.760058 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 175/357] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:20 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:21.783526 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6caa0844-a5fe-4a65-8673-6aba1b5816a7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:21.785569 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6caa0844-a5fe-4a65-8673-6aba1b5816a7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:21.793583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6caa0844-a5fe-4a65-8673-6aba1b5816a7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:21.794086 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6caa0844-a5fe-4a65-8673-6aba1b5816a7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:21.794523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6caa0844-a5fe-4a65-8673-6aba1b5816a7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:21.795260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6caa0844-a5fe-4a65-8673-6aba1b5816a7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:21.795900 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6caa0844-a5fe-4a65-8673-6aba1b5816a7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:21.796509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6caa0844-a5fe-4a65-8673-6aba1b5816a7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:21.941933 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6caa0844-a5fe-4a65-8673-6aba1b5816a7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:21.950542 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6caa0844-a5fe-4a65-8673-6aba1b5816a7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.171516 Oct 06 11:06:21.951113 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 183/358] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:21 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:22.978357 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a31723f-1e64-42f5-ab63-ec7d0b3b11ed tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:22.978962 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a31723f-1e64-42f5-ab63-ec7d0b3b11ed tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:22.985304 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a31723f-1e64-42f5-ab63-ec7d0b3b11ed tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:22.985801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a31723f-1e64-42f5-ab63-ec7d0b3b11ed tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:22.986341 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a31723f-1e64-42f5-ab63-ec7d0b3b11ed tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:22.987061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a31723f-1e64-42f5-ab63-ec7d0b3b11ed tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:22.987527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a31723f-1e64-42f5-ab63-ec7d0b3b11ed tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:22.987996 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a31723f-1e64-42f5-ab63-ec7d0b3b11ed tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:23.382279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a31723f-1e64-42f5-ab63-ec7d0b3b11ed tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:23.390185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a31723f-1e64-42f5-ab63-ec7d0b3b11ed tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.415820 Oct 06 11:06:23.390754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 176/359] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:22 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:24.414873 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0e5f766-1ee9-4fba-af6b-6083772db8ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:24.415497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a0e5f766-1ee9-4fba-af6b-6083772db8ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:24.421721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0e5f766-1ee9-4fba-af6b-6083772db8ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:24.422207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0e5f766-1ee9-4fba-af6b-6083772db8ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:24.422637 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0e5f766-1ee9-4fba-af6b-6083772db8ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:24.423362 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0e5f766-1ee9-4fba-af6b-6083772db8ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:24.423865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0e5f766-1ee9-4fba-af6b-6083772db8ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:24.424291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0e5f766-1ee9-4fba-af6b-6083772db8ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:24.584771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a0e5f766-1ee9-4fba-af6b-6083772db8ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:24.593281 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a0e5f766-1ee9-4fba-af6b-6083772db8ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.182119 Oct 06 11:06:24.593939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 184/360] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:24 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:25.617579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8a9577ce-2b1d-4957-a122-c3f9795fbefe tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:25.619710 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8a9577ce-2b1d-4957-a122-c3f9795fbefe tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:25.627004 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a9577ce-2b1d-4957-a122-c3f9795fbefe tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:25.628692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a9577ce-2b1d-4957-a122-c3f9795fbefe tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:25.629152 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a9577ce-2b1d-4957-a122-c3f9795fbefe tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:25.630019 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a9577ce-2b1d-4957-a122-c3f9795fbefe tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:25.631373 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a9577ce-2b1d-4957-a122-c3f9795fbefe tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:25.631910 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a9577ce-2b1d-4957-a122-c3f9795fbefe tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:25.816231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8a9577ce-2b1d-4957-a122-c3f9795fbefe tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:25.822405 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8a9577ce-2b1d-4957-a122-c3f9795fbefe tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.209312 Oct 06 11:06:25.824402 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 177/361] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:25 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:26.845734 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d1791393-174e-4435-8791-dd7cb92c2180 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:26.847582 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d1791393-174e-4435-8791-dd7cb92c2180 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:26.855990 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1791393-174e-4435-8791-dd7cb92c2180 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:26.855990 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1791393-174e-4435-8791-dd7cb92c2180 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:26.855990 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1791393-174e-4435-8791-dd7cb92c2180 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:26.859019 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1791393-174e-4435-8791-dd7cb92c2180 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:26.859493 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1791393-174e-4435-8791-dd7cb92c2180 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:26.859955 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1791393-174e-4435-8791-dd7cb92c2180 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:27.029159 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d1791393-174e-4435-8791-dd7cb92c2180 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:27.037187 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d1791393-174e-4435-8791-dd7cb92c2180 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.195983 Oct 06 11:06:27.037764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 185/362] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:26 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:28.063511 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abfce569-3f38-4fcb-a8f3-68eab5d012eb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:28.065484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abfce569-3f38-4fcb-a8f3-68eab5d012eb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:28.072100 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abfce569-3f38-4fcb-a8f3-68eab5d012eb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:28.072618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abfce569-3f38-4fcb-a8f3-68eab5d012eb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:28.073180 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abfce569-3f38-4fcb-a8f3-68eab5d012eb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:28.073913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abfce569-3f38-4fcb-a8f3-68eab5d012eb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:28.074420 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abfce569-3f38-4fcb-a8f3-68eab5d012eb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:28.075031 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abfce569-3f38-4fcb-a8f3-68eab5d012eb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:28.270780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-abfce569-3f38-4fcb-a8f3-68eab5d012eb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:28.281879 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abfce569-3f38-4fcb-a8f3-68eab5d012eb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.221589 Oct 06 11:06:28.283829 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 178/363] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:28 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:29.310156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b60a3504-1f50-492c-a77f-fe8f183cdf6c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:29.312012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b60a3504-1f50-492c-a77f-fe8f183cdf6c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:29.320406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b60a3504-1f50-492c-a77f-fe8f183cdf6c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:29.320889 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b60a3504-1f50-492c-a77f-fe8f183cdf6c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:29.321342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b60a3504-1f50-492c-a77f-fe8f183cdf6c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:29.322445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b60a3504-1f50-492c-a77f-fe8f183cdf6c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:29.322893 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b60a3504-1f50-492c-a77f-fe8f183cdf6c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:29.323459 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b60a3504-1f50-492c-a77f-fe8f183cdf6c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:29.345992 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:29.480053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b60a3504-1f50-492c-a77f-fe8f183cdf6c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:29.489174 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b60a3504-1f50-492c-a77f-fe8f183cdf6c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.184450 Oct 06 11:06:29.489823 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 186/364] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:29 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:06:30.516524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ae87328-4a40-4e5a-ac45-9ae1fd69c0ce tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:30.519533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ae87328-4a40-4e5a-ac45-9ae1fd69c0ce tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:30.528044 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ae87328-4a40-4e5a-ac45-9ae1fd69c0ce tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:30.528554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ae87328-4a40-4e5a-ac45-9ae1fd69c0ce tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:30.529318 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ae87328-4a40-4e5a-ac45-9ae1fd69c0ce tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:30.530840 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ae87328-4a40-4e5a-ac45-9ae1fd69c0ce tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:30.531639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ae87328-4a40-4e5a-ac45-9ae1fd69c0ce tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:30.532472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ae87328-4a40-4e5a-ac45-9ae1fd69c0ce tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:30.804923 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3ae87328-4a40-4e5a-ac45-9ae1fd69c0ce tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:30.816663 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ae87328-4a40-4e5a-ac45-9ae1fd69c0ce tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.307209 Oct 06 11:06:30.817360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 179/365] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:30 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:31.842528 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2175b3ce-d668-453d-bbc4-c304556129f0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:31.843120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2175b3ce-d668-453d-bbc4-c304556129f0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:31.847314 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=46 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:31.851115 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2175b3ce-d668-453d-bbc4-c304556129f0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:31.851613 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2175b3ce-d668-453d-bbc4-c304556129f0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:31.852091 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2175b3ce-d668-453d-bbc4-c304556129f0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:31.853066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2175b3ce-d668-453d-bbc4-c304556129f0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:31.853715 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2175b3ce-d668-453d-bbc4-c304556129f0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:31.854464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2175b3ce-d668-453d-bbc4-c304556129f0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:32.033501 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2175b3ce-d668-453d-bbc4-c304556129f0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:32.043163 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2175b3ce-d668-453d-bbc4-c304556129f0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.205486 Oct 06 11:06:32.067058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 187/366] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:31 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:33.074877 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65beb97c-c4ac-4c07-8243-9d34c8af2372 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:33.076311 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65beb97c-c4ac-4c07-8243-9d34c8af2372 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:33.088262 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65beb97c-c4ac-4c07-8243-9d34c8af2372 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:33.088963 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65beb97c-c4ac-4c07-8243-9d34c8af2372 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:33.089592 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65beb97c-c4ac-4c07-8243-9d34c8af2372 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:33.090490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65beb97c-c4ac-4c07-8243-9d34c8af2372 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:33.091155 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65beb97c-c4ac-4c07-8243-9d34c8af2372 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:33.091788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65beb97c-c4ac-4c07-8243-9d34c8af2372 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:33.115667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:33.307363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-65beb97c-c4ac-4c07-8243-9d34c8af2372 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:33.319717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65beb97c-c4ac-4c07-8243-9d34c8af2372 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.248549 Oct 06 11:06:33.320457 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 180/367] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:33 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:34.342383 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-96c1d7ca-eeed-4139-a6ac-83199315ad57 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:34.342995 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-96c1d7ca-eeed-4139-a6ac-83199315ad57 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:34.350068 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96c1d7ca-eeed-4139-a6ac-83199315ad57 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:34.350547 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96c1d7ca-eeed-4139-a6ac-83199315ad57 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:34.350974 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96c1d7ca-eeed-4139-a6ac-83199315ad57 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:34.351653 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96c1d7ca-eeed-4139-a6ac-83199315ad57 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:34.352148 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96c1d7ca-eeed-4139-a6ac-83199315ad57 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:34.352570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96c1d7ca-eeed-4139-a6ac-83199315ad57 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:34.478790 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-96c1d7ca-eeed-4139-a6ac-83199315ad57 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:34.487023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-96c1d7ca-eeed-4139-a6ac-83199315ad57 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.148393 Oct 06 11:06:34.487587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 188/368] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:34 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:35.509966 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3ce02ac-86e0-4ec7-aa54-575639e06197 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:35.510582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d3ce02ac-86e0-4ec7-aa54-575639e06197 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:35.516808 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3ce02ac-86e0-4ec7-aa54-575639e06197 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:35.517320 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3ce02ac-86e0-4ec7-aa54-575639e06197 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:35.517754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3ce02ac-86e0-4ec7-aa54-575639e06197 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:35.518445 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3ce02ac-86e0-4ec7-aa54-575639e06197 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:35.519261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3ce02ac-86e0-4ec7-aa54-575639e06197 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:35.519684 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3ce02ac-86e0-4ec7-aa54-575639e06197 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:35.649828 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d3ce02ac-86e0-4ec7-aa54-575639e06197 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:35.657487 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d3ce02ac-86e0-4ec7-aa54-575639e06197 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.151994 Oct 06 11:06:35.658061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 181/369] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:35 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:36.681532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ad9bcd6-4ec0-48a1-a09f-6fd2a0186790 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:36.682137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ad9bcd6-4ec0-48a1-a09f-6fd2a0186790 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:36.688456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad9bcd6-4ec0-48a1-a09f-6fd2a0186790 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:36.689049 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad9bcd6-4ec0-48a1-a09f-6fd2a0186790 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:36.689589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad9bcd6-4ec0-48a1-a09f-6fd2a0186790 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:36.690291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad9bcd6-4ec0-48a1-a09f-6fd2a0186790 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:36.690744 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad9bcd6-4ec0-48a1-a09f-6fd2a0186790 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:36.691349 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad9bcd6-4ec0-48a1-a09f-6fd2a0186790 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:36.829134 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ad9bcd6-4ec0-48a1-a09f-6fd2a0186790 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:36.837555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ad9bcd6-4ec0-48a1-a09f-6fd2a0186790 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.160535 Oct 06 11:06:36.840023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 189/370] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:36 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:37.861785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b50d8fa-4ec5-4003-94ee-29d8aaec9504 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:37.862970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b50d8fa-4ec5-4003-94ee-29d8aaec9504 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:37.864829 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=40 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:37.870645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b50d8fa-4ec5-4003-94ee-29d8aaec9504 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:37.871307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b50d8fa-4ec5-4003-94ee-29d8aaec9504 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:37.871972 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b50d8fa-4ec5-4003-94ee-29d8aaec9504 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:37.872688 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b50d8fa-4ec5-4003-94ee-29d8aaec9504 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:37.873146 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b50d8fa-4ec5-4003-94ee-29d8aaec9504 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:37.873731 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b50d8fa-4ec5-4003-94ee-29d8aaec9504 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:38.016765 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3b50d8fa-4ec5-4003-94ee-29d8aaec9504 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:38.025167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b50d8fa-4ec5-4003-94ee-29d8aaec9504 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.167880 Oct 06 11:06:38.025846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 182/371] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:37 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:39.062419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-87e2a8af-4259-4112-88a8-584921b1a4f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:39.066673 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-87e2a8af-4259-4112-88a8-584921b1a4f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:39.094681 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87e2a8af-4259-4112-88a8-584921b1a4f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:39.102380 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87e2a8af-4259-4112-88a8-584921b1a4f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:39.102847 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87e2a8af-4259-4112-88a8-584921b1a4f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:39.104250 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87e2a8af-4259-4112-88a8-584921b1a4f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:39.104721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87e2a8af-4259-4112-88a8-584921b1a4f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:39.105153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87e2a8af-4259-4112-88a8-584921b1a4f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:39.236951 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-87e2a8af-4259-4112-88a8-584921b1a4f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:39.244624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-87e2a8af-4259-4112-88a8-584921b1a4f7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.199111 Oct 06 11:06:39.245213 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 190/372] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:39 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:40.247718 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1775669862", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "networks": [{"uuid": "64387bc0-fbf9-44d4-9497-6fe113ce8fc4"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:06:40.267732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e59fe0a9-33d4-4a4e-9eaa-c5d09af9719e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:40.268751 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e59fe0a9-33d4-4a4e-9eaa-c5d09af9719e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:40.275070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e59fe0a9-33d4-4a4e-9eaa-c5d09af9719e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:40.275554 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e59fe0a9-33d4-4a4e-9eaa-c5d09af9719e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:40.276030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e59fe0a9-33d4-4a4e-9eaa-c5d09af9719e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:40.276715 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e59fe0a9-33d4-4a4e-9eaa-c5d09af9719e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:40.277168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e59fe0a9-33d4-4a4e-9eaa-c5d09af9719e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:40.277590 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e59fe0a9-33d4-4a4e-9eaa-c5d09af9719e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:40.303205 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] validate_networks() for [('64387bc0-fbf9-44d4-9497-6fe113ce8fc4', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:06:40.405931 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e59fe0a9-33d4-4a4e-9eaa-c5d09af9719e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:40.414707 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e59fe0a9-33d4-4a4e-9eaa-c5d09af9719e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1502 microversion: 2.1 time: 0.150504 Oct 06 11:06:40.415288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 191/373] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:40 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:06:40.436881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e89ca64-37d5-47de-ab76-8fa8fa8f4068"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:06:40.439602 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:40.445568 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:40.446122 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:40.446622 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:40.447382 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:40.447938 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:40.448402 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:40.472166 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] HTTP exception thrown: Cannot 'attach_volume' instance 41685b83-a75b-4abc-814c-c9a4424f2c65 while it is in vm_state rescued Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Request method failure captured: Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65/os-volume_attachments HTTP/1.1 Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 74 Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYu0enH4vmsKaJVbdYN_HXF96VpdOfcnSPVjuOyC1wHfnVf-P5CdJP_RhW1d5ghD_rC7x0bdbKgaYHfMIElHsj8h1NA1rTfAWXvAIerZh8U8vsnNP1tXgQcEtSqpkhXEfWvyuSjFOkqhXel7QtylouArs23P4CdP8S_7KApeM7ViKk Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 4ebb258de32f40c68f86e4b401efde5d Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:06:40.473969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 4ebb258de32f40c68f86e4b401efde5d Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-ServerRescueNegativeTestJSON-1763361212-project Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: f1815cf2b3f347eb8276769cc30cf116 Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1763361212-project Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {"volumeAttachment": {"volumeId": "7e89ca64-37d5-47de-ab76-8fa8fa8f4068"}} Oct 06 11:06:40.475548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Cannot 'attach_volume' instance 41685b83-a75b-4abc-814c-c9a4424f2c65 while it is in vm_state rescued Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'server_id': '41685b83-a75b-4abc-814c-c9a4424f2c65', 'body': {'volumeAttachment': {'volumeId': '7e89ca64-37d5-47de-ab76-8fa8fa8f4068'}}} Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 41685b83-a75b-4abc-814c-c9a4424f2c65 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:06:40.476430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 41685b83-a75b-4abc-814c-c9a4424f2c65 while it is in vm_state rescued Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:06:40.477628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:06:40.478923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:06:40.478923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:06:40.478923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 41685b83-a75b-4abc-814c-c9a4424f2c65 while it is in vm_state rescued Oct 06 11:06:40.478923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:06:40.478923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Returning 409 to user: Cannot 'attach_volume' instance 41685b83-a75b-4abc-814c-c9a4424f2c65 while it is in vm_state rescued {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:06:40.478923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-58c62ed5-3c87-4231-9e3a-adb1033e4c5d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042791 Oct 06 11:06:40.478923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 192/374] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:06:40 2022] POST /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 06 11:06:40.484255 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-15176ce8-2dfb-4b71-82c7-3894cd310d6d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:06:40.484775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-15176ce8-2dfb-4b71-82c7-3894cd310d6d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:40.491270 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15176ce8-2dfb-4b71-82c7-3894cd310d6d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:40.491752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15176ce8-2dfb-4b71-82c7-3894cd310d6d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:40.492222 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15176ce8-2dfb-4b71-82c7-3894cd310d6d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:40.492918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15176ce8-2dfb-4b71-82c7-3894cd310d6d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:40.493366 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15176ce8-2dfb-4b71-82c7-3894cd310d6d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:40.493782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15176ce8-2dfb-4b71-82c7-3894cd310d6d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:40.562748 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-15176ce8-2dfb-4b71-82c7-3894cd310d6d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65/action" status: 202 len: 0 microversion: 2.1 time: 0.081866 Oct 06 11:06:40.564426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 193/375] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:06:40 2022] POST /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 11:06:40.574042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3dffeb7c-c90b-4775-b72e-c60684ae7a09 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:40.574744 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3dffeb7c-c90b-4775-b72e-c60684ae7a09 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:40.582616 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dffeb7c-c90b-4775-b72e-c60684ae7a09 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:40.583236 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dffeb7c-c90b-4775-b72e-c60684ae7a09 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:40.583705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dffeb7c-c90b-4775-b72e-c60684ae7a09 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:40.585235 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dffeb7c-c90b-4775-b72e-c60684ae7a09 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:40.585381 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dffeb7c-c90b-4775-b72e-c60684ae7a09 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:40.585947 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dffeb7c-c90b-4775-b72e-c60684ae7a09 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:40.670150 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:06:40.670583 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:06:40.671063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:06:40.671478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:06:40.671946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:06:40.681687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:40.682225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:40.682665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:40.683395 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:40.683870 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:40.684300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:40.701532 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Getting quotas for project fb718a8a6011481c8c425b25f426aa3f. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:06:40.707004 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Getting quotas for user bb58f4400de84c13ab7ffda8490f28cd and project fb718a8a6011481c8c425b25f426aa3f. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:06:40.718302 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:06:40.721527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:06:40.784036 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c618edc6-304a-45c4-853f-e86bad36f63b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540455 Oct 06 11:06:40.784691 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 183/376] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:06:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:06:40.796116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c3886ef7-2b24-4a76-8707-a65b22cec580 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:40.796736 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c3886ef7-2b24-4a76-8707-a65b22cec580 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:40.807512 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3dffeb7c-c90b-4775-b72e-c60684ae7a09 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:40.815084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3dffeb7c-c90b-4775-b72e-c60684ae7a09 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.245223 Oct 06 11:06:40.815688 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 194/377] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:40 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:06:40.863130 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c3886ef7-2b24-4a76-8707-a65b22cec580 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:40.870803 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c3886ef7-2b24-4a76-8707-a65b22cec580 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1214 microversion: 2.1 time: 0.078614 Oct 06 11:06:40.871358 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 184/378] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:40 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:41.841325 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0dd49b80-cb65-47a6-a7a7-ac88c506abcc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:41.841977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0dd49b80-cb65-47a6-a7a7-ac88c506abcc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:41.849020 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd49b80-cb65-47a6-a7a7-ac88c506abcc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:41.849518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd49b80-cb65-47a6-a7a7-ac88c506abcc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:41.849960 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd49b80-cb65-47a6-a7a7-ac88c506abcc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:41.850669 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd49b80-cb65-47a6-a7a7-ac88c506abcc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:41.851124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd49b80-cb65-47a6-a7a7-ac88c506abcc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:41.851552 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd49b80-cb65-47a6-a7a7-ac88c506abcc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:41.893708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9904d350-7aa9-4425-aa50-dc1f86d3037c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:41.894246 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9904d350-7aa9-4425-aa50-dc1f86d3037c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:41.900375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9904d350-7aa9-4425-aa50-dc1f86d3037c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:41.900874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9904d350-7aa9-4425-aa50-dc1f86d3037c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:41.901315 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9904d350-7aa9-4425-aa50-dc1f86d3037c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:41.902196 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9904d350-7aa9-4425-aa50-dc1f86d3037c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:41.902664 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9904d350-7aa9-4425-aa50-dc1f86d3037c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:41.903096 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9904d350-7aa9-4425-aa50-dc1f86d3037c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:41.971412 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9904d350-7aa9-4425-aa50-dc1f86d3037c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:41.979161 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9904d350-7aa9-4425-aa50-dc1f86d3037c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1218 microversion: 2.1 time: 0.089835 Oct 06 11:06:41.979723 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 185/379] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:41 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:06:41.984752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0dd49b80-cb65-47a6-a7a7-ac88c506abcc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:41.992792 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0dd49b80-cb65-47a6-a7a7-ac88c506abcc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.155545 Oct 06 11:06:41.993349 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 195/380] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:41 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:43.001143 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52cbd286-c85f-454f-87b7-fe6c3650bc08 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:43.002213 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-52cbd286-c85f-454f-87b7-fe6c3650bc08 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:43.008085 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52cbd286-c85f-454f-87b7-fe6c3650bc08 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:43.008568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52cbd286-c85f-454f-87b7-fe6c3650bc08 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:43.009000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52cbd286-c85f-454f-87b7-fe6c3650bc08 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:43.009688 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52cbd286-c85f-454f-87b7-fe6c3650bc08 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:43.010137 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52cbd286-c85f-454f-87b7-fe6c3650bc08 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:43.010557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52cbd286-c85f-454f-87b7-fe6c3650bc08 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:43.016154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a4045e7-d4e0-403a-925f-d314aed2de68 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:43.016769 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a4045e7-d4e0-403a-925f-d314aed2de68 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:43.024218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4045e7-d4e0-403a-925f-d314aed2de68 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:43.024698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4045e7-d4e0-403a-925f-d314aed2de68 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:43.025132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4045e7-d4e0-403a-925f-d314aed2de68 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:43.025817 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4045e7-d4e0-403a-925f-d314aed2de68 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:43.026264 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4045e7-d4e0-403a-925f-d314aed2de68 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:43.026685 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4045e7-d4e0-403a-925f-d314aed2de68 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:43.071824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-52cbd286-c85f-454f-87b7-fe6c3650bc08 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:43.082016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-52cbd286-c85f-454f-87b7-fe6c3650bc08 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1218 microversion: 2.1 time: 0.084599 Oct 06 11:06:43.082791 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 186/381] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:42 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:43.155932 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a4045e7-d4e0-403a-925f-d314aed2de68 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:43.164113 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a4045e7-d4e0-403a-925f-d314aed2de68 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.151751 Oct 06 11:06:43.164680 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 196/382] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:43 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:06:44.105895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4735379d-0ebc-4ee3-9f85-720b4cc276a4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:44.106499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4735379d-0ebc-4ee3-9f85-720b4cc276a4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:44.113015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4735379d-0ebc-4ee3-9f85-720b4cc276a4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:44.113499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4735379d-0ebc-4ee3-9f85-720b4cc276a4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:44.113932 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4735379d-0ebc-4ee3-9f85-720b4cc276a4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:44.114618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4735379d-0ebc-4ee3-9f85-720b4cc276a4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:44.115069 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4735379d-0ebc-4ee3-9f85-720b4cc276a4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:44.115490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4735379d-0ebc-4ee3-9f85-720b4cc276a4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:44.175472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4735379d-0ebc-4ee3-9f85-720b4cc276a4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:44.182934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4735379d-0ebc-4ee3-9f85-720b4cc276a4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1218 microversion: 2.1 time: 0.081003 Oct 06 11:06:44.183489 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 187/383] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:44 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:44.186659 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0efbfe4-1000-468d-8ce6-5bb317bba6d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:44.187269 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a0efbfe4-1000-468d-8ce6-5bb317bba6d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:44.193683 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0efbfe4-1000-468d-8ce6-5bb317bba6d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:44.194173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0efbfe4-1000-468d-8ce6-5bb317bba6d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:44.194607 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0efbfe4-1000-468d-8ce6-5bb317bba6d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:44.195299 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0efbfe4-1000-468d-8ce6-5bb317bba6d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:44.195755 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0efbfe4-1000-468d-8ce6-5bb317bba6d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:44.196409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0efbfe4-1000-468d-8ce6-5bb317bba6d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:44.321359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a0efbfe4-1000-468d-8ce6-5bb317bba6d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:44.328839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a0efbfe4-1000-468d-8ce6-5bb317bba6d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.145955 Oct 06 11:06:44.329487 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 197/384] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:44 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:06:45.206692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1db9282b-5b79-4470-8db7-58365b18c0e8 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:45.207408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1db9282b-5b79-4470-8db7-58365b18c0e8 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:45.213838 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db9282b-5b79-4470-8db7-58365b18c0e8 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:45.214323 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db9282b-5b79-4470-8db7-58365b18c0e8 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:45.214922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db9282b-5b79-4470-8db7-58365b18c0e8 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:45.215851 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db9282b-5b79-4470-8db7-58365b18c0e8 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:45.216529 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db9282b-5b79-4470-8db7-58365b18c0e8 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:45.217196 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db9282b-5b79-4470-8db7-58365b18c0e8 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:45.283411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1db9282b-5b79-4470-8db7-58365b18c0e8 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:45.290966 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1db9282b-5b79-4470-8db7-58365b18c0e8 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1266 microversion: 2.1 time: 0.088674 Oct 06 11:06:45.291523 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 188/385] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:45 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:45.351766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cace2fd8-8774-49d6-9c6f-649c522ff41e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:45.352408 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cace2fd8-8774-49d6-9c6f-649c522ff41e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:45.358752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cace2fd8-8774-49d6-9c6f-649c522ff41e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:45.359236 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cace2fd8-8774-49d6-9c6f-649c522ff41e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:45.359670 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cace2fd8-8774-49d6-9c6f-649c522ff41e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:45.360390 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cace2fd8-8774-49d6-9c6f-649c522ff41e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:45.361662 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cace2fd8-8774-49d6-9c6f-649c522ff41e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:45.362473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cace2fd8-8774-49d6-9c6f-649c522ff41e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:45.490337 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cace2fd8-8774-49d6-9c6f-649c522ff41e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:45.497851 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cace2fd8-8774-49d6-9c6f-649c522ff41e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.149938 Oct 06 11:06:45.498406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 198/386] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:45 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:46.314499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebcee65c-376a-4b34-a4ed-5b98ec62349e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:46.315355 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebcee65c-376a-4b34-a4ed-5b98ec62349e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:46.321034 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebcee65c-376a-4b34-a4ed-5b98ec62349e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:46.321522 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebcee65c-376a-4b34-a4ed-5b98ec62349e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:46.321954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebcee65c-376a-4b34-a4ed-5b98ec62349e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:46.322641 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebcee65c-376a-4b34-a4ed-5b98ec62349e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:46.323087 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebcee65c-376a-4b34-a4ed-5b98ec62349e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:46.323498 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebcee65c-376a-4b34-a4ed-5b98ec62349e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:46.389053 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebcee65c-376a-4b34-a4ed-5b98ec62349e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:46.397933 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebcee65c-376a-4b34-a4ed-5b98ec62349e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1266 microversion: 2.1 time: 0.087115 Oct 06 11:06:46.398500 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 189/387] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:46 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:46.521805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6418a50f-e114-4390-ac3f-40758271cdc0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:46.522674 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6418a50f-e114-4390-ac3f-40758271cdc0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:46.528983 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6418a50f-e114-4390-ac3f-40758271cdc0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:46.529469 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6418a50f-e114-4390-ac3f-40758271cdc0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:46.529921 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6418a50f-e114-4390-ac3f-40758271cdc0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:46.530640 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6418a50f-e114-4390-ac3f-40758271cdc0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:46.531098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6418a50f-e114-4390-ac3f-40758271cdc0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:46.531611 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6418a50f-e114-4390-ac3f-40758271cdc0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:46.680970 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6418a50f-e114-4390-ac3f-40758271cdc0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:46.688695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6418a50f-e114-4390-ac3f-40758271cdc0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.171388 Oct 06 11:06:46.689271 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 199/388] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:46 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:47.421257 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-116192fe-accb-471e-9f6f-104cb8940a06 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:47.421866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-116192fe-accb-471e-9f6f-104cb8940a06 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:47.428333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-116192fe-accb-471e-9f6f-104cb8940a06 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:47.428819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-116192fe-accb-471e-9f6f-104cb8940a06 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:47.429257 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-116192fe-accb-471e-9f6f-104cb8940a06 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:47.429946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-116192fe-accb-471e-9f6f-104cb8940a06 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:47.430399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-116192fe-accb-471e-9f6f-104cb8940a06 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:47.430822 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-116192fe-accb-471e-9f6f-104cb8940a06 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:47.505739 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-116192fe-accb-471e-9f6f-104cb8940a06 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:47.515534 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-116192fe-accb-471e-9f6f-104cb8940a06 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1266 microversion: 2.1 time: 0.097910 Oct 06 11:06:47.516300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 190/389] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:47 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:47.711415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b6efb652-ba1d-40db-8441-9adda98dd917 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:47.712050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b6efb652-ba1d-40db-8441-9adda98dd917 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:47.718363 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6efb652-ba1d-40db-8441-9adda98dd917 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:47.718835 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6efb652-ba1d-40db-8441-9adda98dd917 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:47.719260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6efb652-ba1d-40db-8441-9adda98dd917 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:47.719960 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6efb652-ba1d-40db-8441-9adda98dd917 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:47.720408 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6efb652-ba1d-40db-8441-9adda98dd917 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:47.721044 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6efb652-ba1d-40db-8441-9adda98dd917 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:47.846463 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b6efb652-ba1d-40db-8441-9adda98dd917 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:47.853990 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b6efb652-ba1d-40db-8441-9adda98dd917 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.146476 Oct 06 11:06:47.854618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 200/390] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:47 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:48.539267 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9226335a-09ca-45ad-bc2e-371ceb3d623b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:48.539907 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9226335a-09ca-45ad-bc2e-371ceb3d623b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:48.546158 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9226335a-09ca-45ad-bc2e-371ceb3d623b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:48.546648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9226335a-09ca-45ad-bc2e-371ceb3d623b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:48.547337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9226335a-09ca-45ad-bc2e-371ceb3d623b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:48.547775 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9226335a-09ca-45ad-bc2e-371ceb3d623b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:48.548259 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9226335a-09ca-45ad-bc2e-371ceb3d623b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:48.548716 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9226335a-09ca-45ad-bc2e-371ceb3d623b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:48.616055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9226335a-09ca-45ad-bc2e-371ceb3d623b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:48.623631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9226335a-09ca-45ad-bc2e-371ceb3d623b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1266 microversion: 2.1 time: 0.088321 Oct 06 11:06:48.624291 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 191/391] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:48 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:48.876804 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84888ba7-b888-4134-aa01-5d149476e215 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:48.877999 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84888ba7-b888-4134-aa01-5d149476e215 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:48.884414 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84888ba7-b888-4134-aa01-5d149476e215 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:48.884894 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84888ba7-b888-4134-aa01-5d149476e215 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:48.885323 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84888ba7-b888-4134-aa01-5d149476e215 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:48.886004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84888ba7-b888-4134-aa01-5d149476e215 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:48.886452 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84888ba7-b888-4134-aa01-5d149476e215 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:48.886869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84888ba7-b888-4134-aa01-5d149476e215 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:49.014849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-84888ba7-b888-4134-aa01-5d149476e215 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:49.022690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84888ba7-b888-4134-aa01-5d149476e215 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.149455 Oct 06 11:06:49.023253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 201/392] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:48 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:49.647324 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb42f3e1-be26-425d-9290-d24ccfff334a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:49.647913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb42f3e1-be26-425d-9290-d24ccfff334a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:49.653737 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb42f3e1-be26-425d-9290-d24ccfff334a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:49.654213 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb42f3e1-be26-425d-9290-d24ccfff334a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:49.654643 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb42f3e1-be26-425d-9290-d24ccfff334a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:49.655325 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb42f3e1-be26-425d-9290-d24ccfff334a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:49.655773 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb42f3e1-be26-425d-9290-d24ccfff334a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:49.656224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb42f3e1-be26-425d-9290-d24ccfff334a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:49.717922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb42f3e1-be26-425d-9290-d24ccfff334a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:49.726340 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb42f3e1-be26-425d-9290-d24ccfff334a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1266 microversion: 2.1 time: 0.083768 Oct 06 11:06:49.728889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 192/393] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:49 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:50.045294 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-937782de-28d8-4a40-95b3-63cb8538b56d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:50.045906 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-937782de-28d8-4a40-95b3-63cb8538b56d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:50.052739 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-937782de-28d8-4a40-95b3-63cb8538b56d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:50.053221 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-937782de-28d8-4a40-95b3-63cb8538b56d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:50.053656 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-937782de-28d8-4a40-95b3-63cb8538b56d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:50.054348 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-937782de-28d8-4a40-95b3-63cb8538b56d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:50.054796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-937782de-28d8-4a40-95b3-63cb8538b56d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:50.055213 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-937782de-28d8-4a40-95b3-63cb8538b56d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:50.073419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:50.183568 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-937782de-28d8-4a40-95b3-63cb8538b56d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:50.191686 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-937782de-28d8-4a40-95b3-63cb8538b56d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.150182 Oct 06 11:06:50.192287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 202/394] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:50 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:50.752004 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8506e297-3f3c-46fb-8c80-c342052fd962 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:50.753285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8506e297-3f3c-46fb-8c80-c342052fd962 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:50.755086 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:50.760571 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8506e297-3f3c-46fb-8c80-c342052fd962 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:50.761052 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8506e297-3f3c-46fb-8c80-c342052fd962 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:50.761484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8506e297-3f3c-46fb-8c80-c342052fd962 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:50.762173 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8506e297-3f3c-46fb-8c80-c342052fd962 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:50.762624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8506e297-3f3c-46fb-8c80-c342052fd962 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:50.763043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8506e297-3f3c-46fb-8c80-c342052fd962 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:50.832274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8506e297-3f3c-46fb-8c80-c342052fd962 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:50.839728 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8506e297-3f3c-46fb-8c80-c342052fd962 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1266 microversion: 2.1 time: 0.091567 Oct 06 11:06:50.840308 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 193/395] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:50 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:51.214497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-05fcae14-d0c0-49a3-8ab5-1578b7034583 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:51.215159 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-05fcae14-d0c0-49a3-8ab5-1578b7034583 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:51.222224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fcae14-d0c0-49a3-8ab5-1578b7034583 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:51.222700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fcae14-d0c0-49a3-8ab5-1578b7034583 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:51.223132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fcae14-d0c0-49a3-8ab5-1578b7034583 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:51.223818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fcae14-d0c0-49a3-8ab5-1578b7034583 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:51.224296 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fcae14-d0c0-49a3-8ab5-1578b7034583 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:51.224721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fcae14-d0c0-49a3-8ab5-1578b7034583 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:51.354192 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-05fcae14-d0c0-49a3-8ab5-1578b7034583 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:51.361914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-05fcae14-d0c0-49a3-8ab5-1578b7034583 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.151085 Oct 06 11:06:51.362473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 203/396] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:51 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:51.862390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d85edbce-81d6-492b-82c1-928382bf6c23 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:51.862933 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d85edbce-81d6-492b-82c1-928382bf6c23 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:51.864778 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:51.870316 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d85edbce-81d6-492b-82c1-928382bf6c23 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:51.870831 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d85edbce-81d6-492b-82c1-928382bf6c23 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:51.871266 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d85edbce-81d6-492b-82c1-928382bf6c23 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:51.871996 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d85edbce-81d6-492b-82c1-928382bf6c23 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:51.872467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d85edbce-81d6-492b-82c1-928382bf6c23 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:51.872890 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d85edbce-81d6-492b-82c1-928382bf6c23 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:51.934799 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d85edbce-81d6-492b-82c1-928382bf6c23 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:51.943549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d85edbce-81d6-492b-82c1-928382bf6c23 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1266 microversion: 2.1 time: 0.085078 Oct 06 11:06:51.944163 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 194/397] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:51 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:52.384611 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3bd5eabc-59d3-4842-8e56-b1d381747764 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:52.385245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3bd5eabc-59d3-4842-8e56-b1d381747764 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:52.391959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bd5eabc-59d3-4842-8e56-b1d381747764 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:52.392455 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bd5eabc-59d3-4842-8e56-b1d381747764 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:52.392906 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bd5eabc-59d3-4842-8e56-b1d381747764 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:52.393896 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bd5eabc-59d3-4842-8e56-b1d381747764 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:52.394353 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bd5eabc-59d3-4842-8e56-b1d381747764 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:52.394783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bd5eabc-59d3-4842-8e56-b1d381747764 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:52.528253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3bd5eabc-59d3-4842-8e56-b1d381747764 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:52.536498 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3bd5eabc-59d3-4842-8e56-b1d381747764 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1510 microversion: 2.1 time: 0.155738 Oct 06 11:06:52.537064 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 204/398] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:52 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:52.966199 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4917f777-849e-4454-af3d-a7ca0504ef6c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:52.966823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4917f777-849e-4454-af3d-a7ca0504ef6c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:52.972886 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4917f777-849e-4454-af3d-a7ca0504ef6c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:52.973920 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4917f777-849e-4454-af3d-a7ca0504ef6c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:52.974365 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4917f777-849e-4454-af3d-a7ca0504ef6c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:52.975166 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4917f777-849e-4454-af3d-a7ca0504ef6c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:52.975632 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4917f777-849e-4454-af3d-a7ca0504ef6c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:52.976084 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4917f777-849e-4454-af3d-a7ca0504ef6c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:53.053450 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4917f777-849e-4454-af3d-a7ca0504ef6c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:53.061727 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4917f777-849e-4454-af3d-a7ca0504ef6c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1274 microversion: 2.1 time: 0.099215 Oct 06 11:06:53.063446 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 195/399] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:52 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:53.569612 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9202ae2-4d73-46ff-b319-0d1ec2ec581a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:53.570283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e9202ae2-4d73-46ff-b319-0d1ec2ec581a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:53.577408 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9202ae2-4d73-46ff-b319-0d1ec2ec581a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:53.577983 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9202ae2-4d73-46ff-b319-0d1ec2ec581a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:53.578701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9202ae2-4d73-46ff-b319-0d1ec2ec581a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:53.581105 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9202ae2-4d73-46ff-b319-0d1ec2ec581a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:53.582313 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9202ae2-4d73-46ff-b319-0d1ec2ec581a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:53.582760 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9202ae2-4d73-46ff-b319-0d1ec2ec581a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:53.896982 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e9202ae2-4d73-46ff-b319-0d1ec2ec581a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:53.905464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e9202ae2-4d73-46ff-b319-0d1ec2ec581a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1516 microversion: 2.1 time: 0.348249 Oct 06 11:06:53.906068 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 205/400] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:53 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1516 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:54.086418 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-da24d0cc-46b4-4b60-a87e-e4fa94a3b038 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:54.086993 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-da24d0cc-46b4-4b60-a87e-e4fa94a3b038 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:54.093202 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da24d0cc-46b4-4b60-a87e-e4fa94a3b038 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:54.093917 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da24d0cc-46b4-4b60-a87e-e4fa94a3b038 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:54.094513 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da24d0cc-46b4-4b60-a87e-e4fa94a3b038 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:54.095284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da24d0cc-46b4-4b60-a87e-e4fa94a3b038 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:54.095654 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da24d0cc-46b4-4b60-a87e-e4fa94a3b038 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:54.096371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da24d0cc-46b4-4b60-a87e-e4fa94a3b038 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:54.243060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-da24d0cc-46b4-4b60-a87e-e4fa94a3b038 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:54.253974 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-da24d0cc-46b4-4b60-a87e-e4fa94a3b038 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.171332 Oct 06 11:06:54.255006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 196/401] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:54 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:54.898912 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-db1a1e9d-9a97-4c7a-bfbe-3d2be2ae411f req-87097901-dfb2-4964-89d0-b810655701a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3515b84-f9df-4927-aa3d-31b71dd06541", "tag": "859adaef-c5c8-4d5c-aee4-6750c5b11793"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:06:54.912006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-db1a1e9d-9a97-4c7a-bfbe-3d2be2ae411f req-87097901-dfb2-4964-89d0-b810655701a9 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:54.912837 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-db1a1e9d-9a97-4c7a-bfbe-3d2be2ae411f req-87097901-dfb2-4964-89d0-b810655701a9 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:54.913602 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-db1a1e9d-9a97-4c7a-bfbe-3d2be2ae411f req-87097901-dfb2-4964-89d0-b810655701a9 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:54.931960 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-db1a1e9d-9a97-4c7a-bfbe-3d2be2ae411f req-87097901-dfb2-4964-89d0-b810655701a9 service nova] Creating event network-changed:859adaef-c5c8-4d5c-aee4-6750c5b11793 for instance e3515b84-f9df-4927-aa3d-31b71dd06541 on hv-cinder-86020 Oct 06 11:06:54.952833 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-db1a1e9d-9a97-4c7a-bfbe-3d2be2ae411f req-87097901-dfb2-4964-89d0-b810655701a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058151 Oct 06 11:06:54.953693 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 206/402] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:06:55.277947 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5905c394-55f4-4ea8-9a03-9d23fd864da2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:55.279189 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5905c394-55f4-4ea8-9a03-9d23fd864da2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:55.287460 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5905c394-55f4-4ea8-9a03-9d23fd864da2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:55.287892 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5905c394-55f4-4ea8-9a03-9d23fd864da2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:55.288473 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5905c394-55f4-4ea8-9a03-9d23fd864da2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:55.289195 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5905c394-55f4-4ea8-9a03-9d23fd864da2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:55.289659 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5905c394-55f4-4ea8-9a03-9d23fd864da2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:55.290101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5905c394-55f4-4ea8-9a03-9d23fd864da2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:55.290720 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16dcc8b7-c8d5-459f-aacd-e6f64288482d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'create', calling method: .version_select at 0x7f92a6f67af0>, body: {"keypair": {"name": "tempest-keypair-1355366370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjd9u46FTnq4ynrPA5eoERyyYeKZMBMENwj7LyWkyVTIp2cErNdsi0R79JcN5eURDK3ldC0+JFaQJ4BUlJnW3cKJODgHkVw4doI754/bIGUm+NoyEEUKWVjBPEzMGMedQ=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:06:55.307052 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-16dcc8b7-c8d5-459f-aacd-e6f64288482d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Getting quotas for project 4ebb258de32f40c68f86e4b401efde5d. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:06:55.310866 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-16dcc8b7-c8d5-459f-aacd-e6f64288482d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Getting quotas for user f1815cf2b3f347eb8276769cc30cf116 and project 4ebb258de32f40c68f86e4b401efde5d. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:06:55.335470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-16dcc8b7-c8d5-459f-aacd-e6f64288482d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048813 Oct 06 11:06:55.336211 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 207/403] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Oct 6 11:06:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:06:55.435121 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5905c394-55f4-4ea8-9a03-9d23fd864da2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:55.443400 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5905c394-55f4-4ea8-9a03-9d23fd864da2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.169634 Oct 06 11:06:55.444103 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 197/404] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:55 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:56.467198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f5c95ad-4431-4ef9-9878-9add5a02f010 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:56.467964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5f5c95ad-4431-4ef9-9878-9add5a02f010 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:56.475014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c95ad-4431-4ef9-9878-9add5a02f010 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:56.475497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c95ad-4431-4ef9-9878-9add5a02f010 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:56.476124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c95ad-4431-4ef9-9878-9add5a02f010 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:56.476994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c95ad-4431-4ef9-9878-9add5a02f010 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:56.477607 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c95ad-4431-4ef9-9878-9add5a02f010 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:56.478028 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c95ad-4431-4ef9-9878-9add5a02f010 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:56.663659 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f5c95ad-4431-4ef9-9878-9add5a02f010 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:56.677824 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f5c95ad-4431-4ef9-9878-9add5a02f010 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.214891 Oct 06 11:06:56.692256 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 208/405] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:56 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:56.763139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-709720866", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66a88666-ebf0-4b86-a615-d5110a6e14c5"}], "security_groups": [{"name": "tempest-securitygroup--1137239241"}], "key_name": "tempest-keypair-1355366370", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:06:56.870756 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] validate_networks() for [('66a88666-ebf0-4b86-a615-d5110a6e14c5', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:06:57.373665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:06:57.373908 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:06:57.374389 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:06:57.374800 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:06:57.375224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:06:57.384356 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:57.384846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:57.385315 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:57.388888 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:57.389375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:57.389814 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:57.407635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Getting quotas for project 4ebb258de32f40c68f86e4b401efde5d. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:06:57.412391 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Getting quotas for user f1815cf2b3f347eb8276769cc30cf116 and project 4ebb258de32f40c68f86e4b401efde5d. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:06:57.425522 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:06:57.427675 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:06:57.485496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6e0b6ca-b111-42a3-9dd9-1065d15912d4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.726966 Oct 06 11:06:57.486452 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 198/406] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:06:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 11:06:57.498063 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e8198f0-6c29-4ff7-a983-c31d9dc77170 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:57.498690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e8198f0-6c29-4ff7-a983-c31d9dc77170 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:57.561638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e8198f0-6c29-4ff7-a983-c31d9dc77170 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:57.570917 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e8198f0-6c29-4ff7-a983-c31d9dc77170 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1245 microversion: 2.1 time: 0.076626 Oct 06 11:06:57.571808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 209/407] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:57 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:57.701647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e641ec8-bf39-46d8-9615-9ee26a64955a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:57.702336 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e641ec8-bf39-46d8-9615-9ee26a64955a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:57.709326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e641ec8-bf39-46d8-9615-9ee26a64955a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:57.709889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e641ec8-bf39-46d8-9615-9ee26a64955a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:57.710443 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e641ec8-bf39-46d8-9615-9ee26a64955a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:57.711588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e641ec8-bf39-46d8-9615-9ee26a64955a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:57.712145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e641ec8-bf39-46d8-9615-9ee26a64955a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:57.712622 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e641ec8-bf39-46d8-9615-9ee26a64955a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:57.735088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:57.874795 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e641ec8-bf39-46d8-9615-9ee26a64955a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:57.883807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e641ec8-bf39-46d8-9615-9ee26a64955a tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.186023 Oct 06 11:06:57.884777 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 199/408] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:57 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:58.594716 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34998e0f-85af-429d-8601-3ee492da2cfb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:58.595348 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-34998e0f-85af-429d-8601-3ee492da2cfb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:58.610674 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34998e0f-85af-429d-8601-3ee492da2cfb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:58.612078 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34998e0f-85af-429d-8601-3ee492da2cfb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:58.612519 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34998e0f-85af-429d-8601-3ee492da2cfb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:58.613251 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34998e0f-85af-429d-8601-3ee492da2cfb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:58.613713 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34998e0f-85af-429d-8601-3ee492da2cfb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:58.614143 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34998e0f-85af-429d-8601-3ee492da2cfb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:58.735206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-34998e0f-85af-429d-8601-3ee492da2cfb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:58.746681 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-34998e0f-85af-429d-8601-3ee492da2cfb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1297 microversion: 2.1 time: 0.155163 Oct 06 11:06:58.747877 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 210/409] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:58 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1297 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:58.906966 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5725dea6-14a6-4ccb-9712-72749ea2768f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:58.907888 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5725dea6-14a6-4ccb-9712-72749ea2768f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:58.915164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5725dea6-14a6-4ccb-9712-72749ea2768f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:58.915888 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5725dea6-14a6-4ccb-9712-72749ea2768f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:58.916425 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5725dea6-14a6-4ccb-9712-72749ea2768f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:58.917318 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5725dea6-14a6-4ccb-9712-72749ea2768f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:58.917988 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5725dea6-14a6-4ccb-9712-72749ea2768f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:58.918700 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5725dea6-14a6-4ccb-9712-72749ea2768f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:59.094623 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5725dea6-14a6-4ccb-9712-72749ea2768f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:59.102780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5725dea6-14a6-4ccb-9712-72749ea2768f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.199564 Oct 06 11:06:59.103624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 200/410] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:58 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:06:59.769692 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ebc2973a-0af5-4dbb-9137-eb5d38ec1d4e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:06:59.770447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ebc2973a-0af5-4dbb-9137-eb5d38ec1d4e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:06:59.777114 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc2973a-0af5-4dbb-9137-eb5d38ec1d4e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:59.777538 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc2973a-0af5-4dbb-9137-eb5d38ec1d4e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:59.778175 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc2973a-0af5-4dbb-9137-eb5d38ec1d4e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:59.778871 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc2973a-0af5-4dbb-9137-eb5d38ec1d4e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:06:59.779327 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc2973a-0af5-4dbb-9137-eb5d38ec1d4e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:06:59.779751 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc2973a-0af5-4dbb-9137-eb5d38ec1d4e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:06:59.858229 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebc2973a-0af5-4dbb-9137-eb5d38ec1d4e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:06:59.868045 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ebc2973a-0af5-4dbb-9137-eb5d38ec1d4e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1303 microversion: 2.1 time: 0.101511 Oct 06 11:06:59.868826 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 211/411] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:06:59 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:00.128614 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38310faa-c571-4b68-aae8-b44acb36dda5 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:00.129640 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38310faa-c571-4b68-aae8-b44acb36dda5 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:00.136110 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38310faa-c571-4b68-aae8-b44acb36dda5 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:00.136686 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38310faa-c571-4b68-aae8-b44acb36dda5 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:00.137225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38310faa-c571-4b68-aae8-b44acb36dda5 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:00.138001 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38310faa-c571-4b68-aae8-b44acb36dda5 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:00.138528 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38310faa-c571-4b68-aae8-b44acb36dda5 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:00.139055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38310faa-c571-4b68-aae8-b44acb36dda5 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:00.282858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-38310faa-c571-4b68-aae8-b44acb36dda5 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:00.291898 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38310faa-c571-4b68-aae8-b44acb36dda5 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.167775 Oct 06 11:07:00.292418 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 201/412] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:00 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:00.813766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1360130061", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:00.843527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-434342d1-57df-4682-8b10-8e74224f922a req-df47378e-e513-41bc-9281-1aa95317531f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a", "tag": "ce07790b-c95e-4fab-b759-f35f2b34ca5f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:00.867328 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-434342d1-57df-4682-8b10-8e74224f922a req-df47378e-e513-41bc-9281-1aa95317531f service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:00.867815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-434342d1-57df-4682-8b10-8e74224f922a req-df47378e-e513-41bc-9281-1aa95317531f service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:00.868273 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-434342d1-57df-4682-8b10-8e74224f922a req-df47378e-e513-41bc-9281-1aa95317531f service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:00.879859 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:07:00.890212 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-434342d1-57df-4682-8b10-8e74224f922a req-df47378e-e513-41bc-9281-1aa95317531f service nova] Creating event network-changed:ce07790b-c95e-4fab-b759-f35f2b34ca5f for instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a on hv-cinder-86020 Oct 06 11:07:00.896120 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-434342d1-57df-4682-8b10-8e74224f922a req-df47378e-e513-41bc-9281-1aa95317531f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056006 Oct 06 11:07:00.896721 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 202/413] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:07:00.901957 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0fa8153d-4c63-4d00-a76f-b58c9ae1751f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:00.902652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0fa8153d-4c63-4d00-a76f-b58c9ae1751f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:00.908959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fa8153d-4c63-4d00-a76f-b58c9ae1751f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:00.909464 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fa8153d-4c63-4d00-a76f-b58c9ae1751f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:00.909900 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fa8153d-4c63-4d00-a76f-b58c9ae1751f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:00.910604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fa8153d-4c63-4d00-a76f-b58c9ae1751f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:00.911055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fa8153d-4c63-4d00-a76f-b58c9ae1751f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:00.911481 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fa8153d-4c63-4d00-a76f-b58c9ae1751f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:01.045119 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0fa8153d-4c63-4d00-a76f-b58c9ae1751f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:01.053754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0fa8153d-4c63-4d00-a76f-b58c9ae1751f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1371 microversion: 2.1 time: 0.155645 Oct 06 11:07:01.054368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 203/414] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:00 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:01.314663 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a189f0e4-ddcb-4e99-8312-12b4e4ea1d3d tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:01.315679 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a189f0e4-ddcb-4e99-8312-12b4e4ea1d3d tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:01.321786 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a189f0e4-ddcb-4e99-8312-12b4e4ea1d3d tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:01.322289 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a189f0e4-ddcb-4e99-8312-12b4e4ea1d3d tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:01.322733 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a189f0e4-ddcb-4e99-8312-12b4e4ea1d3d tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:01.323449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a189f0e4-ddcb-4e99-8312-12b4e4ea1d3d tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:01.323942 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a189f0e4-ddcb-4e99-8312-12b4e4ea1d3d tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:01.324373 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a189f0e4-ddcb-4e99-8312-12b4e4ea1d3d tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:01.462315 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a189f0e4-ddcb-4e99-8312-12b4e4ea1d3d tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:01.470138 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a189f0e4-ddcb-4e99-8312-12b4e4ea1d3d tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.159366 Oct 06 11:07:01.470701 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 204/415] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:01 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:01.513521 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:07:01.513949 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:07:01.514429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:07:01.514843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:07:01.515261 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:07:01.524642 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:01.525125 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:01.525566 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:01.526303 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:01.526760 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:01.527190 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:01.544457 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Getting quotas for project dc88ab1bf75e47e2bdd03d3cd3aa0eee. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:07:01.548686 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Getting quotas for user aa74dc9683a3492b9a71c36b5346c686 and project dc88ab1bf75e47e2bdd03d3cd3aa0eee. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:07:01.560552 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:07:01.562859 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:07:01.607650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0560e452-a073-4159-9291-5d2234d45696 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797586 Oct 06 11:07:01.608341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 212/416] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:07:01.620681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d82f9ef4-925e-434e-aace-d8ead5656c5c tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:01.621301 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d82f9ef4-925e-434e-aace-d8ead5656c5c tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:01.677666 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d82f9ef4-925e-434e-aace-d8ead5656c5c tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:01.688399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d82f9ef4-925e-434e-aace-d8ead5656c5c tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1215 microversion: 2.1 time: 0.071450 Oct 06 11:07:01.689613 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 205/417] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:01 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:02.077618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-505c9cf3-54ed-4a01-89de-d77af17796a9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:02.078374 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-505c9cf3-54ed-4a01-89de-d77af17796a9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:02.082551 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:02.089423 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c9cf3-54ed-4a01-89de-d77af17796a9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:02.089912 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c9cf3-54ed-4a01-89de-d77af17796a9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:02.090356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c9cf3-54ed-4a01-89de-d77af17796a9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:02.091059 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c9cf3-54ed-4a01-89de-d77af17796a9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:02.091516 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c9cf3-54ed-4a01-89de-d77af17796a9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:02.091974 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c9cf3-54ed-4a01-89de-d77af17796a9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:02.108002 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-adac2afa-2971-41a8-bb92-bc6716cbe0cb req-6aea37cb-8baa-4356-9f96-777af0979831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3515b84-f9df-4927-aa3d-31b71dd06541", "name": "network-vif-plugged", "status": "completed", "tag": "859adaef-c5c8-4d5c-aee4-6750c5b11793"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:02.119139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-adac2afa-2971-41a8-bb92-bc6716cbe0cb req-6aea37cb-8baa-4356-9f96-777af0979831 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:02.119675 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-adac2afa-2971-41a8-bb92-bc6716cbe0cb req-6aea37cb-8baa-4356-9f96-777af0979831 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:02.120198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-adac2afa-2971-41a8-bb92-bc6716cbe0cb req-6aea37cb-8baa-4356-9f96-777af0979831 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:02.131900 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-adac2afa-2971-41a8-bb92-bc6716cbe0cb req-6aea37cb-8baa-4356-9f96-777af0979831 service nova] Creating event network-vif-plugged:859adaef-c5c8-4d5c-aee4-6750c5b11793 for instance e3515b84-f9df-4927-aa3d-31b71dd06541 on hv-cinder-86020 Oct 06 11:07:02.136880 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-adac2afa-2971-41a8-bb92-bc6716cbe0cb req-6aea37cb-8baa-4356-9f96-777af0979831 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032570 Oct 06 11:07:02.137474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 206/418] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:07:02.229984 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-505c9cf3-54ed-4a01-89de-d77af17796a9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:02.237771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-505c9cf3-54ed-4a01-89de-d77af17796a9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1371 microversion: 2.1 time: 0.165310 Oct 06 11:07:02.238327 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 213/419] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:02 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:02.494288 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-946d5126-ebb4-408d-a8bf-89e22f919c9f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:02.494928 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-946d5126-ebb4-408d-a8bf-89e22f919c9f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:02.501074 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-946d5126-ebb4-408d-a8bf-89e22f919c9f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:02.501559 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-946d5126-ebb4-408d-a8bf-89e22f919c9f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:02.501999 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-946d5126-ebb4-408d-a8bf-89e22f919c9f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:02.503634 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-946d5126-ebb4-408d-a8bf-89e22f919c9f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:02.504132 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-946d5126-ebb4-408d-a8bf-89e22f919c9f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:02.504570 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-946d5126-ebb4-408d-a8bf-89e22f919c9f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:02.634005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-946d5126-ebb4-408d-a8bf-89e22f919c9f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:02.642057 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-946d5126-ebb4-408d-a8bf-89e22f919c9f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.152046 Oct 06 11:07:02.642622 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 207/420] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:02 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:02.710848 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9a5e71d2-5005-4501-b0e2-455d40f534cb tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:02.711491 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9a5e71d2-5005-4501-b0e2-455d40f534cb tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:02.717407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a5e71d2-5005-4501-b0e2-455d40f534cb tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:02.717889 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a5e71d2-5005-4501-b0e2-455d40f534cb tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:02.718330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a5e71d2-5005-4501-b0e2-455d40f534cb tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:02.719018 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a5e71d2-5005-4501-b0e2-455d40f534cb tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:02.719479 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a5e71d2-5005-4501-b0e2-455d40f534cb tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:02.719936 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a5e71d2-5005-4501-b0e2-455d40f534cb tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:02.785920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9a5e71d2-5005-4501-b0e2-455d40f534cb tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:02.793465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9a5e71d2-5005-4501-b0e2-455d40f534cb tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1219 microversion: 2.1 time: 0.086482 Oct 06 11:07:02.794041 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 214/421] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:02 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:03.261351 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8c70208-a396-429b-be57-a2562248f7a1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:03.261974 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8c70208-a396-429b-be57-a2562248f7a1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:03.268777 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c70208-a396-429b-be57-a2562248f7a1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:03.269609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c70208-a396-429b-be57-a2562248f7a1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:03.270039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c70208-a396-429b-be57-a2562248f7a1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:03.270738 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c70208-a396-429b-be57-a2562248f7a1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:03.271194 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c70208-a396-429b-be57-a2562248f7a1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:03.271709 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c70208-a396-429b-be57-a2562248f7a1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:03.397739 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a8c70208-a396-429b-be57-a2562248f7a1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:03.405472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8c70208-a396-429b-be57-a2562248f7a1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1371 microversion: 2.1 time: 0.147965 Oct 06 11:07:03.406043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 208/422] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:03 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:03.665499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e447b548-7332-4a5c-a40e-6547eda75402 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:03.666113 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e447b548-7332-4a5c-a40e-6547eda75402 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:03.672531 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e447b548-7332-4a5c-a40e-6547eda75402 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:03.673009 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e447b548-7332-4a5c-a40e-6547eda75402 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:03.673442 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e447b548-7332-4a5c-a40e-6547eda75402 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:03.674799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e447b548-7332-4a5c-a40e-6547eda75402 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:03.675281 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e447b548-7332-4a5c-a40e-6547eda75402 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:03.675684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e447b548-7332-4a5c-a40e-6547eda75402 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:03.808215 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e447b548-7332-4a5c-a40e-6547eda75402 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:03.816055 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e447b548-7332-4a5c-a40e-6547eda75402 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.154337 Oct 06 11:07:03.816777 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a858d10-8fb5-4eb8-b671-915a9e7bec2b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:03.817235 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 215/423] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:03 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:03.817401 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a858d10-8fb5-4eb8-b671-915a9e7bec2b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:03.823297 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a858d10-8fb5-4eb8-b671-915a9e7bec2b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:03.824023 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a858d10-8fb5-4eb8-b671-915a9e7bec2b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:03.824475 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a858d10-8fb5-4eb8-b671-915a9e7bec2b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:03.825180 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a858d10-8fb5-4eb8-b671-915a9e7bec2b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:03.825647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a858d10-8fb5-4eb8-b671-915a9e7bec2b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:03.826082 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a858d10-8fb5-4eb8-b671-915a9e7bec2b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:03.886643 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4a858d10-8fb5-4eb8-b671-915a9e7bec2b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:03.894759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a858d10-8fb5-4eb8-b671-915a9e7bec2b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1219 microversion: 2.1 time: 0.081861 Oct 06 11:07:03.895315 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 209/424] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:03 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:04.428177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9b91c8ca-64a8-4d72-b19e-a04e156c18f9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:04.428799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9b91c8ca-64a8-4d72-b19e-a04e156c18f9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:04.434575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b91c8ca-64a8-4d72-b19e-a04e156c18f9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:04.435051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b91c8ca-64a8-4d72-b19e-a04e156c18f9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:04.435479 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b91c8ca-64a8-4d72-b19e-a04e156c18f9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:04.436181 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b91c8ca-64a8-4d72-b19e-a04e156c18f9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:04.436623 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b91c8ca-64a8-4d72-b19e-a04e156c18f9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:04.437039 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b91c8ca-64a8-4d72-b19e-a04e156c18f9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:04.698797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9b91c8ca-64a8-4d72-b19e-a04e156c18f9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:04.707665 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9b91c8ca-64a8-4d72-b19e-a04e156c18f9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1371 microversion: 2.1 time: 0.283627 Oct 06 11:07:04.708303 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 216/425] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:04 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:04.838430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cadab2d3-2519-4f44-9bab-8195864f5dd9 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:04.839040 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cadab2d3-2519-4f44-9bab-8195864f5dd9 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:04.844972 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadab2d3-2519-4f44-9bab-8195864f5dd9 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:04.845453 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadab2d3-2519-4f44-9bab-8195864f5dd9 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:04.845889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadab2d3-2519-4f44-9bab-8195864f5dd9 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:04.846580 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadab2d3-2519-4f44-9bab-8195864f5dd9 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:04.847029 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadab2d3-2519-4f44-9bab-8195864f5dd9 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:04.847446 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadab2d3-2519-4f44-9bab-8195864f5dd9 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:04.918224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a32d5b53-b708-418a-a7e6-03cd3c420f96 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:04.918874 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a32d5b53-b708-418a-a7e6-03cd3c420f96 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:04.925756 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a32d5b53-b708-418a-a7e6-03cd3c420f96 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:04.926248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a32d5b53-b708-418a-a7e6-03cd3c420f96 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:04.926689 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a32d5b53-b708-418a-a7e6-03cd3c420f96 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:04.927426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a32d5b53-b708-418a-a7e6-03cd3c420f96 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:04.927908 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a32d5b53-b708-418a-a7e6-03cd3c420f96 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:04.928335 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a32d5b53-b708-418a-a7e6-03cd3c420f96 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:04.976995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cadab2d3-2519-4f44-9bab-8195864f5dd9 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:04.984591 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cadab2d3-2519-4f44-9bab-8195864f5dd9 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.150091 Oct 06 11:07:04.985147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 210/426] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:04 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:04.992487 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a32d5b53-b708-418a-a7e6-03cd3c420f96 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:05.000070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a32d5b53-b708-418a-a7e6-03cd3c420f96 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1267 microversion: 2.1 time: 0.085635 Oct 06 11:07:05.000626 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 217/427] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:04 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:05.730581 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd41f649-1f7b-40c4-9cb2-7d43194de03c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:05.731196 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bd41f649-1f7b-40c4-9cb2-7d43194de03c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:05.737236 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd41f649-1f7b-40c4-9cb2-7d43194de03c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:05.737729 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd41f649-1f7b-40c4-9cb2-7d43194de03c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:05.738176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd41f649-1f7b-40c4-9cb2-7d43194de03c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:05.738879 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd41f649-1f7b-40c4-9cb2-7d43194de03c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:05.739340 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd41f649-1f7b-40c4-9cb2-7d43194de03c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:05.739770 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd41f649-1f7b-40c4-9cb2-7d43194de03c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:05.868568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bd41f649-1f7b-40c4-9cb2-7d43194de03c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:05.876253 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd41f649-1f7b-40c4-9cb2-7d43194de03c tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1371 microversion: 2.1 time: 0.149457 Oct 06 11:07:05.877533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 211/428] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:05 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:06.008198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f24e2b81-f786-42d9-8e7e-2d453ebf62fe tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:06.008818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f24e2b81-f786-42d9-8e7e-2d453ebf62fe tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:06.015074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24e2b81-f786-42d9-8e7e-2d453ebf62fe tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:06.015559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24e2b81-f786-42d9-8e7e-2d453ebf62fe tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:06.016030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24e2b81-f786-42d9-8e7e-2d453ebf62fe tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:06.016735 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24e2b81-f786-42d9-8e7e-2d453ebf62fe tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:06.017187 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24e2b81-f786-42d9-8e7e-2d453ebf62fe tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:06.023731 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94523c69-ab2d-45ca-8808-5089b35a738a tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:06.024376 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94523c69-ab2d-45ca-8808-5089b35a738a tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:06.026080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24e2b81-f786-42d9-8e7e-2d453ebf62fe tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:06.030343 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94523c69-ab2d-45ca-8808-5089b35a738a tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:06.031051 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94523c69-ab2d-45ca-8808-5089b35a738a tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:06.031496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94523c69-ab2d-45ca-8808-5089b35a738a tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:06.032235 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94523c69-ab2d-45ca-8808-5089b35a738a tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:06.032711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94523c69-ab2d-45ca-8808-5089b35a738a tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:06.033125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94523c69-ab2d-45ca-8808-5089b35a738a tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:06.095215 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-94523c69-ab2d-45ca-8808-5089b35a738a tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:06.103269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94523c69-ab2d-45ca-8808-5089b35a738a tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1267 microversion: 2.1 time: 0.083455 Oct 06 11:07:06.104228 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 212/429] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:06 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:06.176423 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f24e2b81-f786-42d9-8e7e-2d453ebf62fe tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:06.184830 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f24e2b81-f786-42d9-8e7e-2d453ebf62fe tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1314 microversion: 2.1 time: 0.180076 Oct 06 11:07:06.185606 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 218/430] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:06 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:06.899321 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d044247-7c22-4b2f-81c8-567d1a97c603 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:06.899979 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d044247-7c22-4b2f-81c8-567d1a97c603 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:06.905851 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d044247-7c22-4b2f-81c8-567d1a97c603 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:06.906332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d044247-7c22-4b2f-81c8-567d1a97c603 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:06.906765 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d044247-7c22-4b2f-81c8-567d1a97c603 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:06.907451 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d044247-7c22-4b2f-81c8-567d1a97c603 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:06.907920 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d044247-7c22-4b2f-81c8-567d1a97c603 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:06.909015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d044247-7c22-4b2f-81c8-567d1a97c603 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:07.045934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d044247-7c22-4b2f-81c8-567d1a97c603 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:07.054494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d044247-7c22-4b2f-81c8-567d1a97c603 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1371 microversion: 2.1 time: 0.159238 Oct 06 11:07:07.055061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 213/431] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:06 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:07.125334 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9330fb67-8274-4317-96e8-46f195af107b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:07.125948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9330fb67-8274-4317-96e8-46f195af107b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:07.132336 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9330fb67-8274-4317-96e8-46f195af107b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:07.132825 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9330fb67-8274-4317-96e8-46f195af107b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:07.133279 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9330fb67-8274-4317-96e8-46f195af107b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:07.133957 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9330fb67-8274-4317-96e8-46f195af107b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:07.134422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9330fb67-8274-4317-96e8-46f195af107b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:07.134850 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9330fb67-8274-4317-96e8-46f195af107b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:07.209650 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9202351b-9278-4b70-aa9c-6704b9f5eb04 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:07.210315 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9202351b-9278-4b70-aa9c-6704b9f5eb04 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:07.216569 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202351b-9278-4b70-aa9c-6704b9f5eb04 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:07.217254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202351b-9278-4b70-aa9c-6704b9f5eb04 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:07.217843 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202351b-9278-4b70-aa9c-6704b9f5eb04 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:07.218722 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202351b-9278-4b70-aa9c-6704b9f5eb04 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:07.219346 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202351b-9278-4b70-aa9c-6704b9f5eb04 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:07.219985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202351b-9278-4b70-aa9c-6704b9f5eb04 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:07.269952 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9330fb67-8274-4317-96e8-46f195af107b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:07.278979 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9330fb67-8274-4317-96e8-46f195af107b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1285 microversion: 2.1 time: 0.157400 Oct 06 11:07:07.279754 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 219/432] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:07 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:07.361229 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9202351b-9278-4b70-aa9c-6704b9f5eb04 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:07.369498 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9202351b-9278-4b70-aa9c-6704b9f5eb04 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1499 microversion: 2.1 time: 0.164667 Oct 06 11:07:07.370060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 214/433] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:07 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1499 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:07.879595 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-209820b2-a8f4-4dec-b6b5-38044e04e302 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:07.880134 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-209820b2-a8f4-4dec-b6b5-38044e04e302 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:07.886041 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209820b2-a8f4-4dec-b6b5-38044e04e302 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:07.886552 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209820b2-a8f4-4dec-b6b5-38044e04e302 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:07.886944 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209820b2-a8f4-4dec-b6b5-38044e04e302 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:07.887764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209820b2-a8f4-4dec-b6b5-38044e04e302 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:07.888267 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209820b2-a8f4-4dec-b6b5-38044e04e302 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:07.888694 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209820b2-a8f4-4dec-b6b5-38044e04e302 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:07.914386 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-209820b2-a8f4-4dec-b6b5-38044e04e302 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:07:07.974591 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:08.027177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-209820b2-a8f4-4dec-b6b5-38044e04e302 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 204 len: 0 microversion: 2.1 time: 0.151727 Oct 06 11:07:08.028149 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 220/434] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:07:07 2022] DELETE /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:07:08.035549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:08.040939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4593ea01-7a80-4e28-a2cb-074743ae78b4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:08.041612 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4593ea01-7a80-4e28-a2cb-074743ae78b4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:08.043567 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:08.052797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4593ea01-7a80-4e28-a2cb-074743ae78b4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:08.053650 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4593ea01-7a80-4e28-a2cb-074743ae78b4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:08.054305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4593ea01-7a80-4e28-a2cb-074743ae78b4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:08.055210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4593ea01-7a80-4e28-a2cb-074743ae78b4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:08.055865 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4593ea01-7a80-4e28-a2cb-074743ae78b4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:08.056474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4593ea01-7a80-4e28-a2cb-074743ae78b4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:08.082542 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ebdd291-26f8-4dac-b150-c86fb9a9efda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:08.083451 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6ebdd291-26f8-4dac-b150-c86fb9a9efda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:08.090721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ebdd291-26f8-4dac-b150-c86fb9a9efda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:08.091817 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ebdd291-26f8-4dac-b150-c86fb9a9efda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:08.093108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ebdd291-26f8-4dac-b150-c86fb9a9efda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:08.094097 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ebdd291-26f8-4dac-b150-c86fb9a9efda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:08.095004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ebdd291-26f8-4dac-b150-c86fb9a9efda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:08.095588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ebdd291-26f8-4dac-b150-c86fb9a9efda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:08.227185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4593ea01-7a80-4e28-a2cb-074743ae78b4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:08.238370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4593ea01-7a80-4e28-a2cb-074743ae78b4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1505 microversion: 2.1 time: 0.204890 Oct 06 11:07:08.239811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 215/435] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:08 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:08.281430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9939dd0e-5f67-437e-9cab-6e6d140b46b3 req-f2a4463b-74bf-471d-8226-5837b033d189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a", "name": "network-vif-plugged", "status": "completed", "tag": "ce07790b-c95e-4fab-b759-f35f2b34ca5f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:08.292298 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9939dd0e-5f67-437e-9cab-6e6d140b46b3 req-f2a4463b-74bf-471d-8226-5837b033d189 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:08.292657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9939dd0e-5f67-437e-9cab-6e6d140b46b3 req-f2a4463b-74bf-471d-8226-5837b033d189 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:08.293288 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9939dd0e-5f67-437e-9cab-6e6d140b46b3 req-f2a4463b-74bf-471d-8226-5837b033d189 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:08.305985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9939dd0e-5f67-437e-9cab-6e6d140b46b3 req-f2a4463b-74bf-471d-8226-5837b033d189 service nova] Creating event network-vif-plugged:ce07790b-c95e-4fab-b759-f35f2b34ca5f for instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a on hv-cinder-86020 Oct 06 11:07:08.311000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9939dd0e-5f67-437e-9cab-6e6d140b46b3 req-f2a4463b-74bf-471d-8226-5837b033d189 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033161 Oct 06 11:07:08.311598 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 216/436] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:07:08.317215 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63a099b8-960b-464b-a0dd-6e1f7b47f190 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:08.317925 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63a099b8-960b-464b-a0dd-6e1f7b47f190 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:08.324299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a099b8-960b-464b-a0dd-6e1f7b47f190 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:08.324800 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a099b8-960b-464b-a0dd-6e1f7b47f190 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:08.325239 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a099b8-960b-464b-a0dd-6e1f7b47f190 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:08.326128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a099b8-960b-464b-a0dd-6e1f7b47f190 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:08.326757 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a099b8-960b-464b-a0dd-6e1f7b47f190 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:08.327192 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a099b8-960b-464b-a0dd-6e1f7b47f190 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:08.363463 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ebdd291-26f8-4dac-b150-c86fb9a9efda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:08.372341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ebdd291-26f8-4dac-b150-c86fb9a9efda tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1371 microversion: 2.1 time: 0.298132 Oct 06 11:07:08.373721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 221/437] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:08 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:08.395460 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-63a099b8-960b-464b-a0dd-6e1f7b47f190 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:08.403426 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63a099b8-960b-464b-a0dd-6e1f7b47f190 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1273 microversion: 2.1 time: 0.090388 Oct 06 11:07:08.404000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 217/438] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:08 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:09.261468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-396191fd-d3c8-435b-9738-a399b149271e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:09.262081 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-396191fd-d3c8-435b-9738-a399b149271e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:09.268745 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396191fd-d3c8-435b-9738-a399b149271e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:09.269220 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396191fd-d3c8-435b-9738-a399b149271e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:09.269649 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396191fd-d3c8-435b-9738-a399b149271e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:09.270331 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396191fd-d3c8-435b-9738-a399b149271e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:09.270774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396191fd-d3c8-435b-9738-a399b149271e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:09.271207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396191fd-d3c8-435b-9738-a399b149271e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:09.395904 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2c0c558-ec09-42a5-9ba0-94148c012dd7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:09.397250 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b2c0c558-ec09-42a5-9ba0-94148c012dd7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:09.404036 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2c0c558-ec09-42a5-9ba0-94148c012dd7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:09.404896 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2c0c558-ec09-42a5-9ba0-94148c012dd7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:09.405455 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2c0c558-ec09-42a5-9ba0-94148c012dd7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:09.406392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2c0c558-ec09-42a5-9ba0-94148c012dd7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:09.406979 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2c0c558-ec09-42a5-9ba0-94148c012dd7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:09.407627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2c0c558-ec09-42a5-9ba0-94148c012dd7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:09.419537 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-396191fd-d3c8-435b-9738-a399b149271e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:09.431070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-396191fd-d3c8-435b-9738-a399b149271e tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1505 microversion: 2.1 time: 0.173285 Oct 06 11:07:09.436883 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 222/439] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:09 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:09.443293 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-620cc981-1cc6-4a0a-ba95-3db1bf78e3bf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:09.444940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-620cc981-1cc6-4a0a-ba95-3db1bf78e3bf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:09.453219 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-620cc981-1cc6-4a0a-ba95-3db1bf78e3bf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:09.453931 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-620cc981-1cc6-4a0a-ba95-3db1bf78e3bf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:09.454372 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-620cc981-1cc6-4a0a-ba95-3db1bf78e3bf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:09.455132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-620cc981-1cc6-4a0a-ba95-3db1bf78e3bf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:09.455590 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-620cc981-1cc6-4a0a-ba95-3db1bf78e3bf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:09.456124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-620cc981-1cc6-4a0a-ba95-3db1bf78e3bf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:09.554437 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2c0c558-ec09-42a5-9ba0-94148c012dd7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:09.563045 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b2c0c558-ec09-42a5-9ba0-94148c012dd7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1371 microversion: 2.1 time: 0.171148 Oct 06 11:07:09.563723 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 218/440] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:09 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:09.728541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-620cc981-1cc6-4a0a-ba95-3db1bf78e3bf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:09.736077 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-620cc981-1cc6-4a0a-ba95-3db1bf78e3bf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.297797 Oct 06 11:07:09.736803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 223/441] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:09 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:10.227862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-60cf137c-bd06-4505-bcad-f7a9d44283d3 req-d0b98152-f791-44d0-8080-23a4cab15e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3", "tag": "703adb53-b78a-48ae-a473-4fd17cdeb621"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:10.237745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-60cf137c-bd06-4505-bcad-f7a9d44283d3 req-d0b98152-f791-44d0-8080-23a4cab15e17 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:10.238244 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-60cf137c-bd06-4505-bcad-f7a9d44283d3 req-d0b98152-f791-44d0-8080-23a4cab15e17 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:10.238656 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-60cf137c-bd06-4505-bcad-f7a9d44283d3 req-d0b98152-f791-44d0-8080-23a4cab15e17 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:10.242527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:10.250441 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-60cf137c-bd06-4505-bcad-f7a9d44283d3 req-d0b98152-f791-44d0-8080-23a4cab15e17 service nova] Creating event network-changed:703adb53-b78a-48ae-a473-4fd17cdeb621 for instance ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 on hv-cinder-86020 Oct 06 11:07:10.256193 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-60cf137c-bd06-4505-bcad-f7a9d44283d3 req-d0b98152-f791-44d0-8080-23a4cab15e17 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031989 Oct 06 11:07:10.256788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 219/442] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:07:10.456217 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0360b974-69e5-4228-87b0-4aa0cc852b5b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:10.456829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0360b974-69e5-4228-87b0-4aa0cc852b5b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:10.463074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0360b974-69e5-4228-87b0-4aa0cc852b5b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:10.463554 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0360b974-69e5-4228-87b0-4aa0cc852b5b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:10.464027 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0360b974-69e5-4228-87b0-4aa0cc852b5b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:10.464715 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0360b974-69e5-4228-87b0-4aa0cc852b5b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:10.465157 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0360b974-69e5-4228-87b0-4aa0cc852b5b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:10.465577 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0360b974-69e5-4228-87b0-4aa0cc852b5b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:10.587652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aefce90d-45bc-4eb8-99e1-0377f6ee1cc8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:10.588557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aefce90d-45bc-4eb8-99e1-0377f6ee1cc8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:10.594942 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefce90d-45bc-4eb8-99e1-0377f6ee1cc8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:10.596401 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefce90d-45bc-4eb8-99e1-0377f6ee1cc8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:10.597069 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefce90d-45bc-4eb8-99e1-0377f6ee1cc8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:10.597801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefce90d-45bc-4eb8-99e1-0377f6ee1cc8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:10.598262 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefce90d-45bc-4eb8-99e1-0377f6ee1cc8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:10.598693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefce90d-45bc-4eb8-99e1-0377f6ee1cc8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:10.606222 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0360b974-69e5-4228-87b0-4aa0cc852b5b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:10.614885 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0360b974-69e5-4228-87b0-4aa0cc852b5b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1505 microversion: 2.1 time: 0.162644 Oct 06 11:07:10.615471 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 224/443] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:10 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:10.758680 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10b1029c-f49a-4247-8423-9edbfa061158 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:10.759384 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10b1029c-f49a-4247-8423-9edbfa061158 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:10.765275 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10b1029c-f49a-4247-8423-9edbfa061158 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:10.765828 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10b1029c-f49a-4247-8423-9edbfa061158 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:10.766329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10b1029c-f49a-4247-8423-9edbfa061158 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:10.767122 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10b1029c-f49a-4247-8423-9edbfa061158 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:10.768102 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10b1029c-f49a-4247-8423-9edbfa061158 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:10.768530 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10b1029c-f49a-4247-8423-9edbfa061158 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:10.884606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aefce90d-45bc-4eb8-99e1-0377f6ee1cc8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:10.894562 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aefce90d-45bc-4eb8-99e1-0377f6ee1cc8 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1371 microversion: 2.1 time: 0.310850 Oct 06 11:07:10.895533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 220/444] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:10 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:10.942868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-10b1029c-f49a-4247-8423-9edbfa061158 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:10.950457 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10b1029c-f49a-4247-8423-9edbfa061158 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.195674 Oct 06 11:07:10.967210 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 225/445] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:10 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:11.138612 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e9d90a11-93c8-4e50-97ce-9669959fa2e4 req-be10ddfe-ac62-4474-809e-e4de8fda96be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3515b84-f9df-4927-aa3d-31b71dd06541", "name": "network-vif-deleted", "tag": "859adaef-c5c8-4d5c-aee4-6750c5b11793"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:11.148728 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e9d90a11-93c8-4e50-97ce-9669959fa2e4 req-be10ddfe-ac62-4474-809e-e4de8fda96be service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:11.149204 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e9d90a11-93c8-4e50-97ce-9669959fa2e4 req-be10ddfe-ac62-4474-809e-e4de8fda96be service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:11.149631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e9d90a11-93c8-4e50-97ce-9669959fa2e4 req-be10ddfe-ac62-4474-809e-e4de8fda96be service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:11.160575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e9d90a11-93c8-4e50-97ce-9669959fa2e4 req-be10ddfe-ac62-4474-809e-e4de8fda96be service nova] Creating event network-vif-deleted:859adaef-c5c8-4d5c-aee4-6750c5b11793 for instance e3515b84-f9df-4927-aa3d-31b71dd06541 on hv-cinder-86020 Oct 06 11:07:11.165390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e9d90a11-93c8-4e50-97ce-9669959fa2e4 req-be10ddfe-ac62-4474-809e-e4de8fda96be service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030351 Oct 06 11:07:11.165969 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 221/446] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:07:11.638500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93b4b0a9-bf1e-4f0c-89a1-fde4c5881e63 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:11.639134 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-93b4b0a9-bf1e-4f0c-89a1-fde4c5881e63 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:11.641604 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:11.642209 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:11.648561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b4b0a9-bf1e-4f0c-89a1-fde4c5881e63 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:11.649052 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b4b0a9-bf1e-4f0c-89a1-fde4c5881e63 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:11.649489 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b4b0a9-bf1e-4f0c-89a1-fde4c5881e63 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:11.650183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b4b0a9-bf1e-4f0c-89a1-fde4c5881e63 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:11.650633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b4b0a9-bf1e-4f0c-89a1-fde4c5881e63 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:11.651066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93b4b0a9-bf1e-4f0c-89a1-fde4c5881e63 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:11.722455 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-93b4b0a9-bf1e-4f0c-89a1-fde4c5881e63 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:11.730106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-93b4b0a9-bf1e-4f0c-89a1-fde4c5881e63 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1463 microversion: 2.1 time: 0.095648 Oct 06 11:07:11.730680 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 226/447] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:11 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1463 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:11.915905 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:11.920183 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01e0f6a5-8ace-448f-8b0c-edec3024b2ab tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:11.920923 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01e0f6a5-8ace-448f-8b0c-edec3024b2ab tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:11.928019 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e0f6a5-8ace-448f-8b0c-edec3024b2ab tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:11.928509 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e0f6a5-8ace-448f-8b0c-edec3024b2ab tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:11.928955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e0f6a5-8ace-448f-8b0c-edec3024b2ab tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:11.929652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e0f6a5-8ace-448f-8b0c-edec3024b2ab tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:11.930114 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e0f6a5-8ace-448f-8b0c-edec3024b2ab tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:11.930544 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e0f6a5-8ace-448f-8b0c-edec3024b2ab tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:11.975277 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16abb1c1-88b5-4e4d-87b6-fc19df67dd63 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:11.975922 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-16abb1c1-88b5-4e4d-87b6-fc19df67dd63 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:11.981727 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16abb1c1-88b5-4e4d-87b6-fc19df67dd63 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:11.982213 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16abb1c1-88b5-4e4d-87b6-fc19df67dd63 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:11.982652 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16abb1c1-88b5-4e4d-87b6-fc19df67dd63 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:11.983350 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16abb1c1-88b5-4e4d-87b6-fc19df67dd63 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:11.983804 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16abb1c1-88b5-4e4d-87b6-fc19df67dd63 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:11.984256 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16abb1c1-88b5-4e4d-87b6-fc19df67dd63 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:12.076759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-01e0f6a5-8ace-448f-8b0c-edec3024b2ab tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:12.085220 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01e0f6a5-8ace-448f-8b0c-edec3024b2ab tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1371 microversion: 2.1 time: 0.170304 Oct 06 11:07:12.086182 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 222/448] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:11 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:12.141560 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-16abb1c1-88b5-4e4d-87b6-fc19df67dd63 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:12.149970 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-16abb1c1-88b5-4e4d-87b6-fc19df67dd63 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.179325 Oct 06 11:07:12.150543 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 227/449] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:11 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:12.753201 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:12.753805 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:12.759724 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:12.760238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:12.760673 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:12.761356 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:12.761805 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:12.762227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:12.792335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:12.792815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:12.793271 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:12.793709 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lazy-loading 'fault' on Instance uuid e3515b84-f9df-4927-aa3d-31b71dd06541 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:07:12.835041 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:12.842802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19450eb6-69b4-4fb1-ae03-6d0d349bd097 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1304 microversion: 2.1 time: 0.094029 Oct 06 11:07:12.843360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 223/450] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:12 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:13.108649 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b047de1-7341-4ab0-b5e1-a059e2d2374b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:13.109270 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b047de1-7341-4ab0-b5e1-a059e2d2374b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:13.117492 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b047de1-7341-4ab0-b5e1-a059e2d2374b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:13.117991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b047de1-7341-4ab0-b5e1-a059e2d2374b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:13.118560 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b047de1-7341-4ab0-b5e1-a059e2d2374b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:13.119266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b047de1-7341-4ab0-b5e1-a059e2d2374b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:13.119725 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b047de1-7341-4ab0-b5e1-a059e2d2374b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:13.120183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b047de1-7341-4ab0-b5e1-a059e2d2374b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:13.173464 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c8e99b6-8471-4876-ae32-d91dc2a504e3 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:13.175203 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5c8e99b6-8471-4876-ae32-d91dc2a504e3 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:13.181402 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8e99b6-8471-4876-ae32-d91dc2a504e3 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:13.181837 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8e99b6-8471-4876-ae32-d91dc2a504e3 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:13.182277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8e99b6-8471-4876-ae32-d91dc2a504e3 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:13.183069 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8e99b6-8471-4876-ae32-d91dc2a504e3 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:13.183518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8e99b6-8471-4876-ae32-d91dc2a504e3 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:13.184146 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8e99b6-8471-4876-ae32-d91dc2a504e3 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:13.333483 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5c8e99b6-8471-4876-ae32-d91dc2a504e3 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:13.341745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c8e99b6-8471-4876-ae32-d91dc2a504e3 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.172069 Oct 06 11:07:13.342222 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 224/451] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:13 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:13.376465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3b047de1-7341-4ab0-b5e1-a059e2d2374b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:13.384371 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b047de1-7341-4ab0-b5e1-a059e2d2374b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1565 microversion: 2.1 time: 0.279565 Oct 06 11:07:13.400083 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 228/452] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:13 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1565 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:13.410005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d25cf3b-fe61-43d8-8542-6ecc9ec2026a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:13.410507 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d25cf3b-fe61-43d8-8542-6ecc9ec2026a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:13.417919 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d25cf3b-fe61-43d8-8542-6ecc9ec2026a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:13.418506 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d25cf3b-fe61-43d8-8542-6ecc9ec2026a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:13.418950 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d25cf3b-fe61-43d8-8542-6ecc9ec2026a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:13.419670 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d25cf3b-fe61-43d8-8542-6ecc9ec2026a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:13.420167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d25cf3b-fe61-43d8-8542-6ecc9ec2026a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:13.420602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d25cf3b-fe61-43d8-8542-6ecc9ec2026a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:13.497423 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d25cf3b-fe61-43d8-8542-6ecc9ec2026a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092020 Oct 06 11:07:13.498294 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 225/453] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Oct 6 11:07:13 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:07:13.866473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:13.867130 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:13.873179 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:13.873663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:13.874097 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:13.874907 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:13.875366 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:13.875784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:13.907177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:13.907657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:13.908734 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:13.909523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lazy-loading 'fault' on Instance uuid e3515b84-f9df-4927-aa3d-31b71dd06541 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:07:13.951701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:13.960072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-881fe9a2-fab0-40ff-a34b-3bd1199c4df4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1304 microversion: 2.1 time: 0.097920 Oct 06 11:07:13.960639 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 229/454] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:13 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:14.366201 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d9f0b483-47a5-4a9d-b6ac-3383db0c4cb4 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:14.366815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d9f0b483-47a5-4a9d-b6ac-3383db0c4cb4 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:14.372714 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9f0b483-47a5-4a9d-b6ac-3383db0c4cb4 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:14.373196 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9f0b483-47a5-4a9d-b6ac-3383db0c4cb4 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:14.373628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9f0b483-47a5-4a9d-b6ac-3383db0c4cb4 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:14.374325 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9f0b483-47a5-4a9d-b6ac-3383db0c4cb4 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:14.374775 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9f0b483-47a5-4a9d-b6ac-3383db0c4cb4 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:14.375195 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9f0b483-47a5-4a9d-b6ac-3383db0c4cb4 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:14.462378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-92fac702-c4e5-4010-98ad-71b7a731fd2b req-c68db1eb-f2da-4a22-b9aa-6d4153f3d8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a", "tag": "ce07790b-c95e-4fab-b759-f35f2b34ca5f"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:14.473730 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-92fac702-c4e5-4010-98ad-71b7a731fd2b req-c68db1eb-f2da-4a22-b9aa-6d4153f3d8dc service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:14.474288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-92fac702-c4e5-4010-98ad-71b7a731fd2b req-c68db1eb-f2da-4a22-b9aa-6d4153f3d8dc service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:14.474785 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-92fac702-c4e5-4010-98ad-71b7a731fd2b req-c68db1eb-f2da-4a22-b9aa-6d4153f3d8dc service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:14.486773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-92fac702-c4e5-4010-98ad-71b7a731fd2b req-c68db1eb-f2da-4a22-b9aa-6d4153f3d8dc service nova] Creating event network-changed:ce07790b-c95e-4fab-b759-f35f2b34ca5f for instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a on hv-cinder-86020 Oct 06 11:07:14.491993 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-92fac702-c4e5-4010-98ad-71b7a731fd2b req-c68db1eb-f2da-4a22-b9aa-6d4153f3d8dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033746 Oct 06 11:07:14.492588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 230/455] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:07:14.526926 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d9f0b483-47a5-4a9d-b6ac-3383db0c4cb4 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:14.534772 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d9f0b483-47a5-4a9d-b6ac-3383db0c4cb4 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.172338 Oct 06 11:07:14.535291 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 226/456] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:14 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:14.986936 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:14.988147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:14.994348 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:14.994832 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:14.995269 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:14.996006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:14.996466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:14.996888 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:15.029589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:15.030077 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:15.030516 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:15.030963 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lazy-loading 'fault' on Instance uuid e3515b84-f9df-4927-aa3d-31b71dd06541 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:07:15.073679 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:15.082564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cba86f23-579a-4391-ae59-2a1a49e63cb3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1304 microversion: 2.1 time: 0.100471 Oct 06 11:07:15.083295 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 231/457] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:14 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:15.558271 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-031a570d-088b-4837-b3a6-82b728c024d7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:15.558894 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-031a570d-088b-4837-b3a6-82b728c024d7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:15.565670 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031a570d-088b-4837-b3a6-82b728c024d7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:15.566169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031a570d-088b-4837-b3a6-82b728c024d7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:15.566611 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031a570d-088b-4837-b3a6-82b728c024d7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:15.567315 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031a570d-088b-4837-b3a6-82b728c024d7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:15.567777 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031a570d-088b-4837-b3a6-82b728c024d7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:15.568233 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031a570d-088b-4837-b3a6-82b728c024d7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:15.700348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-031a570d-088b-4837-b3a6-82b728c024d7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:15.709148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-031a570d-088b-4837-b3a6-82b728c024d7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.154869 Oct 06 11:07:15.709704 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 227/458] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:15 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:16.105697 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:16.106311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:16.113805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:16.114288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:16.114724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:16.115450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:16.115937 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:16.116362 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:16.147249 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:16.147732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:16.148199 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:16.148637 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lazy-loading 'fault' on Instance uuid e3515b84-f9df-4927-aa3d-31b71dd06541 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:07:16.188581 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:16.196778 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e989ffa0-fa4c-451d-b3bc-c8944ad3372f tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 200 len: 1304 microversion: 2.1 time: 0.095091 Oct 06 11:07:16.197341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 232/459] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:16 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:16.732120 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13a9f181-5f97-4b3a-afa3-db0c23e767e5 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:16.732876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13a9f181-5f97-4b3a-afa3-db0c23e767e5 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:16.739671 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a9f181-5f97-4b3a-afa3-db0c23e767e5 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:16.740217 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a9f181-5f97-4b3a-afa3-db0c23e767e5 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:16.740840 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a9f181-5f97-4b3a-afa3-db0c23e767e5 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:16.741742 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a9f181-5f97-4b3a-afa3-db0c23e767e5 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:16.742201 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a9f181-5f97-4b3a-afa3-db0c23e767e5 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:16.742930 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a9f181-5f97-4b3a-afa3-db0c23e767e5 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:16.873445 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-13a9f181-5f97-4b3a-afa3-db0c23e767e5 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:16.881806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13a9f181-5f97-4b3a-afa3-db0c23e767e5 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.153681 Oct 06 11:07:16.882376 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 228/460] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:16 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:17.219962 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:17.220531 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: e3515b84-f9df-4927-aa3d-31b71dd06541] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:17.226813 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:17.227299 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:17.227741 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:17.228468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:17.228926 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:17.229354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:17.242759 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] HTTP exception thrown: Instance e3515b84-f9df-4927-aa3d-31b71dd06541 could not be found. Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Request method failure captured: Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 HTTP/1.1 Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPra5dTl1803U8B6xtf3FJWMH3R3hCIqIKN125Le_4tUl9L0YKsdJv63nO6EvmKLp4BS1yvQMfTx34BuL7s8LZpg8quV9WH2wUmMpr--9qRchRuLydjcBun3y03JbDSy7tTP5J4NMZo6AKI-jKC1s16-6cvFIIvDbfsxN3Ev88PPcg54 Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: fb718a8a6011481c8c425b25f426aa3f Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesActionsTest-491625643 Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:07:17.244415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb718a8a6011481c8c425b25f426aa3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb718a8a6011481c8c425b25f426aa3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fb718a8a6011481c8c425b25f426aa3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fb718a8a6011481c8c425b25f426aa3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-VolumesActionsTest-491625643 Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: fb718a8a6011481c8c425b25f426aa3f Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesActionsTest-491625643 Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-VolumesActionsTest-491625643-project Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: bb58f4400de84c13ab7ffda8490f28cd Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-VolumesActionsTest-491625643-project Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance e3515b84-f9df-4927-aa3d-31b71dd06541 could not be found. Oct 06 11:07:17.246014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': 'e3515b84-f9df-4927-aa3d-31b71dd06541'} Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3515b84-f9df-4927-aa3d-31b71dd06541 could not be found. Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:07:17.247013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3515b84-f9df-4927-aa3d-31b71dd06541 could not be found. Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3515b84-f9df-4927-aa3d-31b71dd06541 could not be found. Oct 06 11:07:17.248564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:07:17.249799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Returning 404 to user: Instance e3515b84-f9df-4927-aa3d-31b71dd06541 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:07:17.249799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b58c941-ca99-4979-ae79-ddc5114e3ccd tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541" status: 404 len: 111 microversion: 2.1 time: 0.029777 Oct 06 11:07:17.249799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 233/461] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:17 2022] GET /compute/v2.1/servers/e3515b84-f9df-4927-aa3d-31b71dd06541 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:07:17.349107 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2046200647", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "networks": [{"uuid": "64387bc0-fbf9-44d4-9497-6fe113ce8fc4"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:17.403058 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] validate_networks() for [('64387bc0-fbf9-44d4-9497-6fe113ce8fc4', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:07:17.748595 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:07:17.749190 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:07:17.749482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:07:17.749889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:07:17.750300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:07:17.759995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:17.760534 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:17.760922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:17.761653 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:17.762118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:17.762545 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:17.779126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Getting quotas for project fb718a8a6011481c8c425b25f426aa3f. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:07:17.783540 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Getting quotas for user bb58f4400de84c13ab7ffda8490f28cd and project fb718a8a6011481c8c425b25f426aa3f. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:07:17.794580 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:07:17.796876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:07:17.841727 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee1563c0-03d4-4e84-b5cf-1ed987e544c3 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496881 Oct 06 11:07:17.842367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 229/462] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:07:17.855087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a432bb9-42aa-405c-b2e0-97cebec7f583 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:17.855913 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8a432bb9-42aa-405c-b2e0-97cebec7f583 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:17.905449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f4c5cb0-209e-44eb-bb58-6b1c951bcdb0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:17.906263 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f4c5cb0-209e-44eb-bb58-6b1c951bcdb0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:17.913379 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f4c5cb0-209e-44eb-bb58-6b1c951bcdb0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:17.913988 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f4c5cb0-209e-44eb-bb58-6b1c951bcdb0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:17.914529 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f4c5cb0-209e-44eb-bb58-6b1c951bcdb0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:17.915431 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f4c5cb0-209e-44eb-bb58-6b1c951bcdb0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:17.916225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f4c5cb0-209e-44eb-bb58-6b1c951bcdb0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:17.916752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f4c5cb0-209e-44eb-bb58-6b1c951bcdb0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:17.920870 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a432bb9-42aa-405c-b2e0-97cebec7f583 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:17.929039 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a432bb9-42aa-405c-b2e0-97cebec7f583 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1214 microversion: 2.1 time: 0.078552 Oct 06 11:07:17.929825 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 234/463] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:17 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:18.058166 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1f4c5cb0-209e-44eb-bb58-6b1c951bcdb0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:18.066753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f4c5cb0-209e-44eb-bb58-6b1c951bcdb0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.165148 Oct 06 11:07:18.067324 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 230/464] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:17 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:18.951382 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-306820f6-6280-41c2-82bd-15cb78486bc1 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:18.951939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-306820f6-6280-41c2-82bd-15cb78486bc1 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:18.959663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-306820f6-6280-41c2-82bd-15cb78486bc1 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:18.960180 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-306820f6-6280-41c2-82bd-15cb78486bc1 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:18.960627 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-306820f6-6280-41c2-82bd-15cb78486bc1 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:18.961317 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-306820f6-6280-41c2-82bd-15cb78486bc1 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:18.961769 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-306820f6-6280-41c2-82bd-15cb78486bc1 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:18.962237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-306820f6-6280-41c2-82bd-15cb78486bc1 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:19.025757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-306820f6-6280-41c2-82bd-15cb78486bc1 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:19.034020 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-306820f6-6280-41c2-82bd-15cb78486bc1 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1266 microversion: 2.1 time: 0.085921 Oct 06 11:07:19.034448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 235/465] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:18 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:19.091395 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c2096d8f-6e5a-452a-b2d5-d2ceb6ce5e89 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:19.092044 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c2096d8f-6e5a-452a-b2d5-d2ceb6ce5e89 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:19.099077 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2096d8f-6e5a-452a-b2d5-d2ceb6ce5e89 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:19.099596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2096d8f-6e5a-452a-b2d5-d2ceb6ce5e89 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:19.100180 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2096d8f-6e5a-452a-b2d5-d2ceb6ce5e89 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:19.100961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2096d8f-6e5a-452a-b2d5-d2ceb6ce5e89 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:19.101464 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2096d8f-6e5a-452a-b2d5-d2ceb6ce5e89 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:19.101959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2096d8f-6e5a-452a-b2d5-d2ceb6ce5e89 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:19.241366 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c2096d8f-6e5a-452a-b2d5-d2ceb6ce5e89 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:19.249595 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c2096d8f-6e5a-452a-b2d5-d2ceb6ce5e89 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.162831 Oct 06 11:07:19.250709 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 231/466] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:19 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:20.056058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-24a301e0-7b3b-44a5-972d-49682863325c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:20.056709 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-24a301e0-7b3b-44a5-972d-49682863325c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:20.063306 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24a301e0-7b3b-44a5-972d-49682863325c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:20.063721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24a301e0-7b3b-44a5-972d-49682863325c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:20.064221 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24a301e0-7b3b-44a5-972d-49682863325c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:20.064915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24a301e0-7b3b-44a5-972d-49682863325c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:20.065472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24a301e0-7b3b-44a5-972d-49682863325c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:20.065934 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24a301e0-7b3b-44a5-972d-49682863325c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:20.224609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-593d2aa3-3e28-415c-8e8b-53660179886d req-aa23a11e-2cd9-46d0-9239-4be73bf2700a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3", "name": "network-vif-plugged", "status": "completed", "tag": "703adb53-b78a-48ae-a473-4fd17cdeb621"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:20.237359 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-593d2aa3-3e28-415c-8e8b-53660179886d req-aa23a11e-2cd9-46d0-9239-4be73bf2700a service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:20.238230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-593d2aa3-3e28-415c-8e8b-53660179886d req-aa23a11e-2cd9-46d0-9239-4be73bf2700a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:20.238824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-593d2aa3-3e28-415c-8e8b-53660179886d req-aa23a11e-2cd9-46d0-9239-4be73bf2700a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:20.253215 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-593d2aa3-3e28-415c-8e8b-53660179886d req-aa23a11e-2cd9-46d0-9239-4be73bf2700a service nova] Creating event network-vif-plugged:703adb53-b78a-48ae-a473-4fd17cdeb621 for instance ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 on hv-cinder-86020 Oct 06 11:07:20.259400 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-593d2aa3-3e28-415c-8e8b-53660179886d req-aa23a11e-2cd9-46d0-9239-4be73bf2700a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039831 Oct 06 11:07:20.260330 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 232/467] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:07:20.267636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-24a301e0-7b3b-44a5-972d-49682863325c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:20.274289 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89164737-0217-4c1a-ba0b-59976dac326d tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:20.275357 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-89164737-0217-4c1a-ba0b-59976dac326d tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:20.277276 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-24a301e0-7b3b-44a5-972d-49682863325c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1314 microversion: 2.1 time: 0.225160 Oct 06 11:07:20.278895 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 236/468] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:20 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:20.301166 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89164737-0217-4c1a-ba0b-59976dac326d tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:20.301669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89164737-0217-4c1a-ba0b-59976dac326d tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:20.302115 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89164737-0217-4c1a-ba0b-59976dac326d tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:20.302832 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89164737-0217-4c1a-ba0b-59976dac326d tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:20.303295 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89164737-0217-4c1a-ba0b-59976dac326d tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:20.303859 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89164737-0217-4c1a-ba0b-59976dac326d tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:20.450820 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-89164737-0217-4c1a-ba0b-59976dac326d tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:20.459518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-89164737-0217-4c1a-ba0b-59976dac326d tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.189675 Oct 06 11:07:20.472868 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 233/469] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:20 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:20.607678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7cc9ad1b-bbb2-45ca-af90-6c68ffc938f7 req-ee936354-f363-43a1-bd3b-8e0b473f4bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5d7f9ad-4fc8-49e2-bb6e-bee30363321b", "tag": "2dad448e-17b8-4929-9a02-f52e569815ec"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:20.617526 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7cc9ad1b-bbb2-45ca-af90-6c68ffc938f7 req-ee936354-f363-43a1-bd3b-8e0b473f4bd9 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:20.618002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7cc9ad1b-bbb2-45ca-af90-6c68ffc938f7 req-ee936354-f363-43a1-bd3b-8e0b473f4bd9 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:20.618490 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7cc9ad1b-bbb2-45ca-af90-6c68ffc938f7 req-ee936354-f363-43a1-bd3b-8e0b473f4bd9 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:20.629392 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7cc9ad1b-bbb2-45ca-af90-6c68ffc938f7 req-ee936354-f363-43a1-bd3b-8e0b473f4bd9 service nova] Creating event network-changed:2dad448e-17b8-4929-9a02-f52e569815ec for instance b5d7f9ad-4fc8-49e2-bb6e-bee30363321b on hv-cinder-86020 Oct 06 11:07:20.634190 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7cc9ad1b-bbb2-45ca-af90-6c68ffc938f7 req-ee936354-f363-43a1-bd3b-8e0b473f4bd9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030309 Oct 06 11:07:20.634775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 237/470] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:07:21.302374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4acf85c-459a-424d-b5df-e38a63ecfd95 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:21.302916 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f4acf85c-459a-424d-b5df-e38a63ecfd95 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:21.308825 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4acf85c-459a-424d-b5df-e38a63ecfd95 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:21.309309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4acf85c-459a-424d-b5df-e38a63ecfd95 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:21.309753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4acf85c-459a-424d-b5df-e38a63ecfd95 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:21.310432 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4acf85c-459a-424d-b5df-e38a63ecfd95 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:21.310883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4acf85c-459a-424d-b5df-e38a63ecfd95 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:21.311304 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4acf85c-459a-424d-b5df-e38a63ecfd95 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:21.442247 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f4acf85c-459a-424d-b5df-e38a63ecfd95 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:21.449720 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f4acf85c-459a-424d-b5df-e38a63ecfd95 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1314 microversion: 2.1 time: 0.152004 Oct 06 11:07:21.450278 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 234/471] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:21 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:21.485571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a346eb0-c618-48ba-bc8a-1957b49fa9c7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:21.486878 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7a346eb0-c618-48ba-bc8a-1957b49fa9c7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:21.493818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a346eb0-c618-48ba-bc8a-1957b49fa9c7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:21.494305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a346eb0-c618-48ba-bc8a-1957b49fa9c7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:21.494734 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a346eb0-c618-48ba-bc8a-1957b49fa9c7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:21.495445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a346eb0-c618-48ba-bc8a-1957b49fa9c7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:21.495924 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a346eb0-c618-48ba-bc8a-1957b49fa9c7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:21.496347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a346eb0-c618-48ba-bc8a-1957b49fa9c7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:21.643231 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7a346eb0-c618-48ba-bc8a-1957b49fa9c7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:21.651012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7a346eb0-c618-48ba-bc8a-1957b49fa9c7 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1315 microversion: 2.1 time: 0.169993 Oct 06 11:07:21.651576 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 238/472] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:21 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:22.472502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bbc9489f-55f8-40d3-9d1a-28a7d4888dd2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:22.473116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bbc9489f-55f8-40d3-9d1a-28a7d4888dd2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:22.479891 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbc9489f-55f8-40d3-9d1a-28a7d4888dd2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:22.480392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbc9489f-55f8-40d3-9d1a-28a7d4888dd2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:22.480856 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbc9489f-55f8-40d3-9d1a-28a7d4888dd2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:22.481565 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbc9489f-55f8-40d3-9d1a-28a7d4888dd2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:22.482027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbc9489f-55f8-40d3-9d1a-28a7d4888dd2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:22.482463 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbc9489f-55f8-40d3-9d1a-28a7d4888dd2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:22.634780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bbc9489f-55f8-40d3-9d1a-28a7d4888dd2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:22.643438 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bbc9489f-55f8-40d3-9d1a-28a7d4888dd2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1314 microversion: 2.1 time: 0.174103 Oct 06 11:07:22.644046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 235/473] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:22 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:22.675538 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ef51a8a-041b-4983-b4e4-0a2b8fc93030 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:22.676794 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6ef51a8a-041b-4983-b4e4-0a2b8fc93030 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:22.686460 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ef51a8a-041b-4983-b4e4-0a2b8fc93030 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:22.687073 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ef51a8a-041b-4983-b4e4-0a2b8fc93030 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:22.687542 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ef51a8a-041b-4983-b4e4-0a2b8fc93030 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:22.688295 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ef51a8a-041b-4983-b4e4-0a2b8fc93030 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:22.688751 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ef51a8a-041b-4983-b4e4-0a2b8fc93030 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:22.689197 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ef51a8a-041b-4983-b4e4-0a2b8fc93030 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:22.709979 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:22.917941 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ef51a8a-041b-4983-b4e4-0a2b8fc93030 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:22.926458 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ef51a8a-041b-4983-b4e4-0a2b8fc93030 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1464 microversion: 2.1 time: 0.255694 Oct 06 11:07:22.926950 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 239/474] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:22 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1464 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:22.974903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3afdea33-3d63-4c30-ad36-2af53238dfd0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:22.975410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3afdea33-3d63-4c30-ad36-2af53238dfd0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:22.981309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3afdea33-3d63-4c30-ad36-2af53238dfd0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:22.981798 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3afdea33-3d63-4c30-ad36-2af53238dfd0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:22.982236 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3afdea33-3d63-4c30-ad36-2af53238dfd0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:22.982931 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3afdea33-3d63-4c30-ad36-2af53238dfd0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:22.983387 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3afdea33-3d63-4c30-ad36-2af53238dfd0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:22.983808 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3afdea33-3d63-4c30-ad36-2af53238dfd0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:23.009574 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3afdea33-3d63-4c30-ad36-2af53238dfd0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:07:23.059505 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:23.085835 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3afdea33-3d63-4c30-ad36-2af53238dfd0 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 204 len: 0 microversion: 2.1 time: 0.114859 Oct 06 11:07:23.086407 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 236/475] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:07:22 2022] DELETE /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:07:23.094507 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a0a9658-ceae-41f2-ad20-1ff4e1fdd1fd tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:23.095107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3a0a9658-ceae-41f2-ad20-1ff4e1fdd1fd tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:23.101683 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a0a9658-ceae-41f2-ad20-1ff4e1fdd1fd tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:23.102164 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a0a9658-ceae-41f2-ad20-1ff4e1fdd1fd tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:23.102595 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a0a9658-ceae-41f2-ad20-1ff4e1fdd1fd tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:23.103271 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a0a9658-ceae-41f2-ad20-1ff4e1fdd1fd tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:23.103718 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a0a9658-ceae-41f2-ad20-1ff4e1fdd1fd tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:23.104167 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a0a9658-ceae-41f2-ad20-1ff4e1fdd1fd tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:23.231288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3a0a9658-ceae-41f2-ad20-1ff4e1fdd1fd tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:23.240061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3a0a9658-ceae-41f2-ad20-1ff4e1fdd1fd tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1470 microversion: 2.1 time: 0.149278 Oct 06 11:07:23.240634 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 240/476] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:23 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:23.670099 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25ecfc6e-5a9c-49dd-a115-17074ddfc4ec tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:23.670811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-25ecfc6e-5a9c-49dd-a115-17074ddfc4ec tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:23.677616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25ecfc6e-5a9c-49dd-a115-17074ddfc4ec tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:23.678107 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25ecfc6e-5a9c-49dd-a115-17074ddfc4ec tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:23.678548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25ecfc6e-5a9c-49dd-a115-17074ddfc4ec tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:23.679249 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25ecfc6e-5a9c-49dd-a115-17074ddfc4ec tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:23.679705 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25ecfc6e-5a9c-49dd-a115-17074ddfc4ec tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:23.680164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25ecfc6e-5a9c-49dd-a115-17074ddfc4ec tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:23.809606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-25ecfc6e-5a9c-49dd-a115-17074ddfc4ec tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:23.817699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-25ecfc6e-5a9c-49dd-a115-17074ddfc4ec tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1314 microversion: 2.1 time: 0.152054 Oct 06 11:07:23.818262 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 237/477] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:23 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:24.263072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8bbed2f1-d30f-4c2c-bc1e-3b71039fe1d6 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:24.263678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8bbed2f1-d30f-4c2c-bc1e-3b71039fe1d6 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:24.270362 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbed2f1-d30f-4c2c-bc1e-3b71039fe1d6 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:24.270852 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbed2f1-d30f-4c2c-bc1e-3b71039fe1d6 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:24.271299 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbed2f1-d30f-4c2c-bc1e-3b71039fe1d6 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:24.272344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbed2f1-d30f-4c2c-bc1e-3b71039fe1d6 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:24.273176 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbed2f1-d30f-4c2c-bc1e-3b71039fe1d6 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:24.274419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbed2f1-d30f-4c2c-bc1e-3b71039fe1d6 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:24.399172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8bbed2f1-d30f-4c2c-bc1e-3b71039fe1d6 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:24.406793 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8bbed2f1-d30f-4c2c-bc1e-3b71039fe1d6 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1470 microversion: 2.1 time: 0.147584 Oct 06 11:07:24.407354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 241/478] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:24 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:24.840802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f72c05fa-12da-4090-bbb8-b29622ee9ef4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:24.841419 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f72c05fa-12da-4090-bbb8-b29622ee9ef4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:24.848371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f72c05fa-12da-4090-bbb8-b29622ee9ef4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:24.848866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f72c05fa-12da-4090-bbb8-b29622ee9ef4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:24.849309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f72c05fa-12da-4090-bbb8-b29622ee9ef4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:24.850009 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f72c05fa-12da-4090-bbb8-b29622ee9ef4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:24.850472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f72c05fa-12da-4090-bbb8-b29622ee9ef4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:24.850903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f72c05fa-12da-4090-bbb8-b29622ee9ef4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:24.980540 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f72c05fa-12da-4090-bbb8-b29622ee9ef4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:24.988287 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f72c05fa-12da-4090-bbb8-b29622ee9ef4 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1314 microversion: 2.1 time: 0.151380 Oct 06 11:07:24.988840 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 238/479] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:24 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:25.429908 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e1bba7c-058f-4b87-9c9d-ad230c814366 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:25.430520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e1bba7c-058f-4b87-9c9d-ad230c814366 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:25.437000 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1bba7c-058f-4b87-9c9d-ad230c814366 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:25.437485 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1bba7c-058f-4b87-9c9d-ad230c814366 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:25.437923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1bba7c-058f-4b87-9c9d-ad230c814366 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:25.438611 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1bba7c-058f-4b87-9c9d-ad230c814366 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:25.439067 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1bba7c-058f-4b87-9c9d-ad230c814366 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:25.440356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1bba7c-058f-4b87-9c9d-ad230c814366 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:25.570028 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e1bba7c-058f-4b87-9c9d-ad230c814366 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:25.577730 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e1bba7c-058f-4b87-9c9d-ad230c814366 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1470 microversion: 2.1 time: 0.151695 Oct 06 11:07:25.578291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 242/480] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:25 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:26.010096 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0aceafca-e270-4ae0-b8a0-6a1dfd9a15a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:26.010669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0aceafca-e270-4ae0-b8a0-6a1dfd9a15a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:26.016601 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aceafca-e270-4ae0-b8a0-6a1dfd9a15a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:26.017096 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aceafca-e270-4ae0-b8a0-6a1dfd9a15a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:26.017623 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aceafca-e270-4ae0-b8a0-6a1dfd9a15a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:26.018321 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aceafca-e270-4ae0-b8a0-6a1dfd9a15a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:26.018784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aceafca-e270-4ae0-b8a0-6a1dfd9a15a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:26.019214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aceafca-e270-4ae0-b8a0-6a1dfd9a15a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:26.157586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0aceafca-e270-4ae0-b8a0-6a1dfd9a15a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:26.166328 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0aceafca-e270-4ae0-b8a0-6a1dfd9a15a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1314 microversion: 2.1 time: 0.160081 Oct 06 11:07:26.166954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 239/481] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:26 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:26.601440 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6cd2ad5e-7bfd-4aca-a111-4598fd6c2fdf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:26.601991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6cd2ad5e-7bfd-4aca-a111-4598fd6c2fdf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:26.608479 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cd2ad5e-7bfd-4aca-a111-4598fd6c2fdf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:26.609014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cd2ad5e-7bfd-4aca-a111-4598fd6c2fdf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:26.609454 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cd2ad5e-7bfd-4aca-a111-4598fd6c2fdf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:26.610147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cd2ad5e-7bfd-4aca-a111-4598fd6c2fdf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:26.610599 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cd2ad5e-7bfd-4aca-a111-4598fd6c2fdf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:26.611598 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cd2ad5e-7bfd-4aca-a111-4598fd6c2fdf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:26.744483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6cd2ad5e-7bfd-4aca-a111-4598fd6c2fdf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:26.753152 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6cd2ad5e-7bfd-4aca-a111-4598fd6c2fdf tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1470 microversion: 2.1 time: 0.154414 Oct 06 11:07:26.753713 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 243/482] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:26 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:27.189583 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e618b32-9174-43c8-bf6b-1e2d91f2d2af tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:27.190238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e618b32-9174-43c8-bf6b-1e2d91f2d2af tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:27.195921 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e618b32-9174-43c8-bf6b-1e2d91f2d2af tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:27.196411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e618b32-9174-43c8-bf6b-1e2d91f2d2af tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:27.196880 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e618b32-9174-43c8-bf6b-1e2d91f2d2af tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:27.197574 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e618b32-9174-43c8-bf6b-1e2d91f2d2af tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:27.198026 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e618b32-9174-43c8-bf6b-1e2d91f2d2af tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:27.198473 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e618b32-9174-43c8-bf6b-1e2d91f2d2af tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:27.324478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e618b32-9174-43c8-bf6b-1e2d91f2d2af tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:27.332475 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e618b32-9174-43c8-bf6b-1e2d91f2d2af tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1314 microversion: 2.1 time: 0.147203 Oct 06 11:07:27.333738 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 240/483] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:27 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:27.775640 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7369259-2dd6-4ecf-8acd-a1909afd5533 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:27.776411 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a7369259-2dd6-4ecf-8acd-a1909afd5533 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:27.782948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7369259-2dd6-4ecf-8acd-a1909afd5533 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:27.783600 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7369259-2dd6-4ecf-8acd-a1909afd5533 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:27.784011 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7369259-2dd6-4ecf-8acd-a1909afd5533 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:27.784703 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7369259-2dd6-4ecf-8acd-a1909afd5533 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:27.785152 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7369259-2dd6-4ecf-8acd-a1909afd5533 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:27.785573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7369259-2dd6-4ecf-8acd-a1909afd5533 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:27.925422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:28.002569 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7369259-2dd6-4ecf-8acd-a1909afd5533 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:28.010247 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a7369259-2dd6-4ecf-8acd-a1909afd5533 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1470 microversion: 2.1 time: 0.238720 Oct 06 11:07:28.010815 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 244/484] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:27 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1470 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:28.271087 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e2633cd7-0c0e-4fda-9d61-6faf5dec76ca req-37137d51-6cdb-4689-aaf8-09e9c88c9f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3", "name": "network-vif-deleted", "tag": "703adb53-b78a-48ae-a473-4fd17cdeb621"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:28.278693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:28.279627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:28.288389 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e2633cd7-0c0e-4fda-9d61-6faf5dec76ca req-37137d51-6cdb-4689-aaf8-09e9c88c9f3a service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:28.289109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e2633cd7-0c0e-4fda-9d61-6faf5dec76ca req-37137d51-6cdb-4689-aaf8-09e9c88c9f3a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:28.289553 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e2633cd7-0c0e-4fda-9d61-6faf5dec76ca req-37137d51-6cdb-4689-aaf8-09e9c88c9f3a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:28.312402 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e2633cd7-0c0e-4fda-9d61-6faf5dec76ca req-37137d51-6cdb-4689-aaf8-09e9c88c9f3a service nova] Creating event network-vif-deleted:703adb53-b78a-48ae-a473-4fd17cdeb621 for instance ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 on hv-cinder-86020 Oct 06 11:07:28.318860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e2633cd7-0c0e-4fda-9d61-6faf5dec76ca req-37137d51-6cdb-4689-aaf8-09e9c88c9f3a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051291 Oct 06 11:07:28.320235 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 241/485] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:07:28.356245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-60148772-91b7-4572-aed4-1dffacb78e3c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:28.357109 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-60148772-91b7-4572-aed4-1dffacb78e3c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:28.369222 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60148772-91b7-4572-aed4-1dffacb78e3c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:28.370142 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60148772-91b7-4572-aed4-1dffacb78e3c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:28.370794 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60148772-91b7-4572-aed4-1dffacb78e3c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:28.371678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60148772-91b7-4572-aed4-1dffacb78e3c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:28.372329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60148772-91b7-4572-aed4-1dffacb78e3c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:28.373023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60148772-91b7-4572-aed4-1dffacb78e3c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:28.526836 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-60148772-91b7-4572-aed4-1dffacb78e3c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:28.535128 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-60148772-91b7-4572-aed4-1dffacb78e3c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1314 microversion: 2.1 time: 0.182798 Oct 06 11:07:28.536008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-fa858af9-2db5-42c2-b6e7-9c6185b02b5d req-bc1a27aa-7dae-48b6-91a4-755a51233b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d7f9ad-4fc8-49e2-bb6e-bee30363321b", "name": "network-vif-plugged", "status": "completed", "tag": "2dad448e-17b8-4929-9a02-f52e569815ec"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:28.551097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fa858af9-2db5-42c2-b6e7-9c6185b02b5d req-bc1a27aa-7dae-48b6-91a4-755a51233b84 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:28.551097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fa858af9-2db5-42c2-b6e7-9c6185b02b5d req-bc1a27aa-7dae-48b6-91a4-755a51233b84 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:28.551097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fa858af9-2db5-42c2-b6e7-9c6185b02b5d req-bc1a27aa-7dae-48b6-91a4-755a51233b84 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:28.552314 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 245/486] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:28 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:28.562201 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-fa858af9-2db5-42c2-b6e7-9c6185b02b5d req-bc1a27aa-7dae-48b6-91a4-755a51233b84 service nova] Creating event network-vif-plugged:2dad448e-17b8-4929-9a02-f52e569815ec for instance b5d7f9ad-4fc8-49e2-bb6e-bee30363321b on hv-cinder-86020 Oct 06 11:07:28.568082 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-fa858af9-2db5-42c2-b6e7-9c6185b02b5d req-bc1a27aa-7dae-48b6-91a4-755a51233b84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037163 Oct 06 11:07:28.568730 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 242/487] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:07:29.033672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:29.034287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:29.040937 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:29.041437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:29.041877 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:29.042575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:29.043031 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:29.043456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:29.076976 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:29.077494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:29.077992 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:29.078774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lazy-loading 'fault' on Instance uuid ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:07:29.133588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa74dc9683a3492b9a71c36b5346c686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc88ab1bf75e47e2bdd03d3cd3aa0eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:29.143357 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c26d6d3-9ed7-4c7d-8252-6be0b8949d47 tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 200 len: 1305 microversion: 2.1 time: 0.113107 Oct 06 11:07:29.144087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 246/488] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:29 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 1305 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:29.559011 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-972bb39d-563b-4892-bd56-1462040d951c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:29.559716 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-972bb39d-563b-4892-bd56-1462040d951c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:29.566644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-972bb39d-563b-4892-bd56-1462040d951c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:29.567072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-972bb39d-563b-4892-bd56-1462040d951c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:29.567516 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-972bb39d-563b-4892-bd56-1462040d951c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:29.568250 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-972bb39d-563b-4892-bd56-1462040d951c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:29.568736 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-972bb39d-563b-4892-bd56-1462040d951c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:29.569165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-972bb39d-563b-4892-bd56-1462040d951c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:29.701922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-972bb39d-563b-4892-bd56-1462040d951c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:29.709620 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-972bb39d-563b-4892-bd56-1462040d951c tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1314 microversion: 2.1 time: 0.154804 Oct 06 11:07:29.710185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 243/489] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:29 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:30.169253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:30.169867 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] [instance: ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:30.176621 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:30.177101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:30.177533 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:30.178217 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:30.178663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:30.179087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:30.192407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] HTTP exception thrown: Instance ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 could not be found. Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Request method failure captured: Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 HTTP/1.1 Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrbTq7U-B69HxStMD-4dcIKgHgmiPCbd1BRukZVOBID-GESrP3ceFcdRRGFSpoNKPR_xdQ9zZFtO_py3EWtEa0krRXOCs0Yru1rSZVv9s87v-GEoykxDjgwjhg9WOJaofluxamX9HlzxEPWG4Yg1drWnB0xK17kD03qI3mFmMPNT6kY Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: dc88ab1bf75e47e2bdd03d3cd3aa0eee Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesNegativeTest-1675793928 Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:07:30.194026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc88ab1bf75e47e2bdd03d3cd3aa0eee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc88ab1bf75e47e2bdd03d3cd3aa0eee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc88ab1bf75e47e2bdd03d3cd3aa0eee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc88ab1bf75e47e2bdd03d3cd3aa0eee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-VolumesNegativeTest-1675793928 Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: dc88ab1bf75e47e2bdd03d3cd3aa0eee Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesNegativeTest-1675793928 Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-VolumesNegativeTest-1675793928-project Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: aa74dc9683a3492b9a71c36b5346c686 Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-VolumesNegativeTest-1675793928-project Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 could not be found. Oct 06 11:07:30.195724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': 'ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3'} Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 could not be found. Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:07:30.197573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 could not be found. Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 could not be found. Oct 06 11:07:30.199042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:07:30.200373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] Returning 404 to user: Instance ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:07:30.200373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c72917b2-d8ab-48e7-b09d-97fb4814aa9b tempest-VolumesNegativeTest-1675793928 tempest-VolumesNegativeTest-1675793928-project] 10.222.0.52 "GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3" status: 404 len: 111 microversion: 2.1 time: 0.030020 Oct 06 11:07:30.200373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 247/490] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:30 2022] GET /compute/v2.1/servers/ae2f2e5b-6728-41cd-8c8e-ac43ae3243f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:07:30.733354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a10f3c42-3377-4338-862e-5c9b8c5aeb01 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:30.734371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a10f3c42-3377-4338-862e-5c9b8c5aeb01 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:30.740264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a10f3c42-3377-4338-862e-5c9b8c5aeb01 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:30.740828 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a10f3c42-3377-4338-862e-5c9b8c5aeb01 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:30.741334 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a10f3c42-3377-4338-862e-5c9b8c5aeb01 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:30.742118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a10f3c42-3377-4338-862e-5c9b8c5aeb01 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:30.742668 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a10f3c42-3377-4338-862e-5c9b8c5aeb01 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:30.743126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a10f3c42-3377-4338-862e-5c9b8c5aeb01 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:30.878496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a10f3c42-3377-4338-862e-5c9b8c5aeb01 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:30.886474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a10f3c42-3377-4338-862e-5c9b8c5aeb01 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1314 microversion: 2.1 time: 0.157272 Oct 06 11:07:30.887030 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 244/491] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:30 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:31.910262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fabf6f2a-a360-4afc-a34c-f02944556f1b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:31.910914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fabf6f2a-a360-4afc-a34c-f02944556f1b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:31.917542 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabf6f2a-a360-4afc-a34c-f02944556f1b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:31.918037 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabf6f2a-a360-4afc-a34c-f02944556f1b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:31.918780 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabf6f2a-a360-4afc-a34c-f02944556f1b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:31.919490 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabf6f2a-a360-4afc-a34c-f02944556f1b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:31.919987 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabf6f2a-a360-4afc-a34c-f02944556f1b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:31.920418 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabf6f2a-a360-4afc-a34c-f02944556f1b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:32.059164 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-fabf6f2a-a360-4afc-a34c-f02944556f1b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:32.067753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fabf6f2a-a360-4afc-a34c-f02944556f1b tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1498 microversion: 2.1 time: 0.161656 Oct 06 11:07:32.068518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 248/492] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:31 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:32.655261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9318c97a-cd51-44e3-9da5-d8b90deb52a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:32.655787 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9318c97a-cd51-44e3-9da5-d8b90deb52a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:32.662329 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9318c97a-cd51-44e3-9da5-d8b90deb52a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:32.662815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9318c97a-cd51-44e3-9da5-d8b90deb52a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:32.663256 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9318c97a-cd51-44e3-9da5-d8b90deb52a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:32.663993 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9318c97a-cd51-44e3-9da5-d8b90deb52a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:32.665219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9318c97a-cd51-44e3-9da5-d8b90deb52a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:32.665219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9318c97a-cd51-44e3-9da5-d8b90deb52a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:32.691448 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9318c97a-cd51-44e3-9da5-d8b90deb52a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:07:32.776395 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9318c97a-cd51-44e3-9da5-d8b90deb52a2 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 204 len: 0 microversion: 2.1 time: 0.124328 Oct 06 11:07:32.777419 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 245/493] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:07:32 2022] DELETE /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:07:32.786156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed54e72a-43c8-426d-84ea-3681f3c61a25 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:32.786766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed54e72a-43c8-426d-84ea-3681f3c61a25 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:32.791495 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:32.795884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54e72a-43c8-426d-84ea-3681f3c61a25 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:32.796370 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54e72a-43c8-426d-84ea-3681f3c61a25 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:32.796804 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54e72a-43c8-426d-84ea-3681f3c61a25 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:32.797499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54e72a-43c8-426d-84ea-3681f3c61a25 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:32.797949 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54e72a-43c8-426d-84ea-3681f3c61a25 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:32.798401 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54e72a-43c8-426d-84ea-3681f3c61a25 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:32.944895 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ed54e72a-43c8-426d-84ea-3681f3c61a25 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:32.952968 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed54e72a-43c8-426d-84ea-3681f3c61a25 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1504 microversion: 2.1 time: 0.171044 Oct 06 11:07:32.953538 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 249/494] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:32 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:33.976867 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71bbfa4b-a9a2-443d-b4af-7ed26e5ecc09 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:33.977645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71bbfa4b-a9a2-443d-b4af-7ed26e5ecc09 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:33.983581 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71bbfa4b-a9a2-443d-b4af-7ed26e5ecc09 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:33.984103 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71bbfa4b-a9a2-443d-b4af-7ed26e5ecc09 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:33.984538 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71bbfa4b-a9a2-443d-b4af-7ed26e5ecc09 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:33.985231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71bbfa4b-a9a2-443d-b4af-7ed26e5ecc09 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:33.985681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71bbfa4b-a9a2-443d-b4af-7ed26e5ecc09 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:33.986178 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71bbfa4b-a9a2-443d-b4af-7ed26e5ecc09 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:34.119629 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-71bbfa4b-a9a2-443d-b4af-7ed26e5ecc09 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:34.127299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71bbfa4b-a9a2-443d-b4af-7ed26e5ecc09 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1504 microversion: 2.1 time: 0.154587 Oct 06 11:07:34.127864 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 246/495] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:33 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:35.150840 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d83c7dbd-961e-4468-ac5d-20d1bb0f57c0 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:35.151461 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d83c7dbd-961e-4468-ac5d-20d1bb0f57c0 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:35.161350 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d83c7dbd-961e-4468-ac5d-20d1bb0f57c0 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:35.161963 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d83c7dbd-961e-4468-ac5d-20d1bb0f57c0 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:35.162284 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d83c7dbd-961e-4468-ac5d-20d1bb0f57c0 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:35.163926 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d83c7dbd-961e-4468-ac5d-20d1bb0f57c0 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:35.164409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d83c7dbd-961e-4468-ac5d-20d1bb0f57c0 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:35.164865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d83c7dbd-961e-4468-ac5d-20d1bb0f57c0 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:35.184904 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-50cec79c-8f51-4e10-9f68-ba53358fd8c7 req-109c6dc7-0b3c-4019-8699-cefff019f092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d7f9ad-4fc8-49e2-bb6e-bee30363321b", "name": "network-vif-deleted", "tag": "2dad448e-17b8-4929-9a02-f52e569815ec"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:35.191390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 11:07:35.191616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Thu Oct 6 11:07:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Oct 06 11:07:35.196461 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-50cec79c-8f51-4e10-9f68-ba53358fd8c7 req-109c6dc7-0b3c-4019-8699-cefff019f092 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:35.196948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-50cec79c-8f51-4e10-9f68-ba53358fd8c7 req-109c6dc7-0b3c-4019-8699-cefff019f092 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:35.197472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-50cec79c-8f51-4e10-9f68-ba53358fd8c7 req-109c6dc7-0b3c-4019-8699-cefff019f092 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:35.210326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-50cec79c-8f51-4e10-9f68-ba53358fd8c7 req-109c6dc7-0b3c-4019-8699-cefff019f092 service nova] Creating event network-vif-deleted:2dad448e-17b8-4929-9a02-f52e569815ec for instance b5d7f9ad-4fc8-49e2-bb6e-bee30363321b on hv-cinder-86020 Oct 06 11:07:35.215496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-50cec79c-8f51-4e10-9f68-ba53358fd8c7 req-109c6dc7-0b3c-4019-8699-cefff019f092 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034416 Oct 06 11:07:35.216137 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 247/496] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:07:35.237963 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d83c7dbd-961e-4468-ac5d-20d1bb0f57c0 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb58f4400de84c13ab7ffda8490f28cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb718a8a6011481c8c425b25f426aa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:35.245781 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d83c7dbd-961e-4468-ac5d-20d1bb0f57c0 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 200 len: 1462 microversion: 2.1 time: 0.099111 Oct 06 11:07:35.246347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 250/497] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:35 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 1462 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:36.269611 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:36.270253 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] [instance: b5d7f9ad-4fc8-49e2-bb6e-bee30363321b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:36.276631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:36.277122 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:36.277566 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:36.278263 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:36.278723 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:36.279151 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:36.293361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] HTTP exception thrown: Instance b5d7f9ad-4fc8-49e2-bb6e-bee30363321b could not be found. Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Request method failure captured: Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b HTTP/1.1 Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPra5dTl1803U8B6xtf3FJWMH3R3hCIqIKN125Le_4tUl9L0YKsdJv63nO6EvmKLp4BS1yvQMfTx34BuL7s8LZpg8quV9WH2wUmMpr--9qRchRuLydjcBun3y03JbDSy7tTP5J4NMZo6AKI-jKC1s16-6cvFIIvDbfsxN3Ev88PPcg54 Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: fb718a8a6011481c8c425b25f426aa3f Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesActionsTest-491625643 Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:07:36.295535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb718a8a6011481c8c425b25f426aa3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb718a8a6011481c8c425b25f426aa3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fb718a8a6011481c8c425b25f426aa3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fb718a8a6011481c8c425b25f426aa3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesActionsTest-491625643 Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: fb718a8a6011481c8c425b25f426aa3f Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesActionsTest-491625643 Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesActionsTest-491625643-project Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: bb58f4400de84c13ab7ffda8490f28cd Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesActionsTest-491625643-project Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance b5d7f9ad-4fc8-49e2-bb6e-bee30363321b could not be found. Oct 06 11:07:36.297089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': 'b5d7f9ad-4fc8-49e2-bb6e-bee30363321b'} Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d7f9ad-4fc8-49e2-bb6e-bee30363321b could not be found. Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:07:36.297937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d7f9ad-4fc8-49e2-bb6e-bee30363321b could not be found. Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d7f9ad-4fc8-49e2-bb6e-bee30363321b could not be found. Oct 06 11:07:36.299862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:07:36.301110 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] Returning 404 to user: Instance b5d7f9ad-4fc8-49e2-bb6e-bee30363321b could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:07:36.301110 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f8f26dd-60b9-46fd-8cb2-37e24091e421 tempest-VolumesActionsTest-491625643 tempest-VolumesActionsTest-491625643-project] 10.222.0.52 "GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b" status: 404 len: 111 microversion: 2.1 time: 0.031660 Oct 06 11:07:36.301110 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 248/498] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:36 2022] GET /compute/v2.1/servers/b5d7f9ad-4fc8-49e2-bb6e-bee30363321b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:07:38.813103 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c411af1-f8da-40f1-aa5b-ee700132e4e1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:38.813690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c411af1-f8da-40f1-aa5b-ee700132e4e1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:38.820091 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c411af1-f8da-40f1-aa5b-ee700132e4e1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:38.820579 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c411af1-f8da-40f1-aa5b-ee700132e4e1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:38.821020 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c411af1-f8da-40f1-aa5b-ee700132e4e1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:38.821714 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c411af1-f8da-40f1-aa5b-ee700132e4e1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:38.822168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c411af1-f8da-40f1-aa5b-ee700132e4e1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:38.822594 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c411af1-f8da-40f1-aa5b-ee700132e4e1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:38.846333 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c411af1-f8da-40f1-aa5b-ee700132e4e1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/ips" status: 200 len: 144 microversion: 2.1 time: 0.037005 Oct 06 11:07:38.846901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 251/499] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Oct 6 11:07:38 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:07:44.328726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42975cc0-59b4-40f8-981e-90158f957f55 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86c055e4-6c29-42e1-b9ed-8b9acf185618"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:44.331134 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42975cc0-59b4-40f8-981e-90158f957f55 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:44.336674 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:44.348442 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42975cc0-59b4-40f8-981e-90158f957f55 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:44.349190 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42975cc0-59b4-40f8-981e-90158f957f55 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:44.349637 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42975cc0-59b4-40f8-981e-90158f957f55 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:44.350416 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42975cc0-59b4-40f8-981e-90158f957f55 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:44.350817 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42975cc0-59b4-40f8-981e-90158f957f55 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:44.351461 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42975cc0-59b4-40f8-981e-90158f957f55 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:44.673482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42975cc0-59b4-40f8-981e-90158f957f55 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348474 Oct 06 11:07:44.674658 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 249/500] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:07:44 2022] POST /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:07:52.427141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae024ebb-007d-4a2d-a9cb-c38878a49dc7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:07:52.430349 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=5 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:52.431106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=70 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:52.437791 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae024ebb-007d-4a2d-a9cb-c38878a49dc7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:52.438479 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae024ebb-007d-4a2d-a9cb-c38878a49dc7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:52.439078 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae024ebb-007d-4a2d-a9cb-c38878a49dc7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:52.515458 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae024ebb-007d-4a2d-a9cb-c38878a49dc7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Going to try to stop instance {{(pid=120602) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 11:07:52.563397 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae024ebb-007d-4a2d-a9cb-c38878a49dc7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/action" status: 202 len: 0 microversion: 2.1 time: 0.140594 Oct 06 11:07:52.568067 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 252/501] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:07:52 2022] POST /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:07:52.574886 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50c9874b-1138-41a5-b13c-fc9db3a6f37c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:52.575804 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-50c9874b-1138-41a5-b13c-fc9db3a6f37c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:52.585572 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50c9874b-1138-41a5-b13c-fc9db3a6f37c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:52.586113 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50c9874b-1138-41a5-b13c-fc9db3a6f37c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:52.586637 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50c9874b-1138-41a5-b13c-fc9db3a6f37c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:52.587490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50c9874b-1138-41a5-b13c-fc9db3a6f37c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:52.587945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50c9874b-1138-41a5-b13c-fc9db3a6f37c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:52.589076 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50c9874b-1138-41a5-b13c-fc9db3a6f37c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:52.732321 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-50c9874b-1138-41a5-b13c-fc9db3a6f37c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:52.741883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50c9874b-1138-41a5-b13c-fc9db3a6f37c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.171097 Oct 06 11:07:52.756012 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 250/502] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:52 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:53.768452 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b95ab8c2-0a06-415a-a95d-cf4aa0762288 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:53.769336 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b95ab8c2-0a06-415a-a95d-cf4aa0762288 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:53.777945 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b95ab8c2-0a06-415a-a95d-cf4aa0762288 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:53.778433 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b95ab8c2-0a06-415a-a95d-cf4aa0762288 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:53.778869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b95ab8c2-0a06-415a-a95d-cf4aa0762288 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:53.779917 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b95ab8c2-0a06-415a-a95d-cf4aa0762288 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:53.780411 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b95ab8c2-0a06-415a-a95d-cf4aa0762288 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:53.781024 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b95ab8c2-0a06-415a-a95d-cf4aa0762288 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:53.937479 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b95ab8c2-0a06-415a-a95d-cf4aa0762288 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:53.946736 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b95ab8c2-0a06-415a-a95d-cf4aa0762288 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.183430 Oct 06 11:07:53.947544 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 253/503] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:53 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:07:54.970901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e3c0eea-4bba-4632-b8c9-7ffb6bb1d12a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:54.971804 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e3c0eea-4bba-4632-b8c9-7ffb6bb1d12a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:54.985970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c0eea-4bba-4632-b8c9-7ffb6bb1d12a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:54.986979 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c0eea-4bba-4632-b8c9-7ffb6bb1d12a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:54.987428 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c0eea-4bba-4632-b8c9-7ffb6bb1d12a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:54.988178 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c0eea-4bba-4632-b8c9-7ffb6bb1d12a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:54.988810 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c0eea-4bba-4632-b8c9-7ffb6bb1d12a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:54.989405 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e3c0eea-4bba-4632-b8c9-7ffb6bb1d12a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:54.998536 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:55.141367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e3c0eea-4bba-4632-b8c9-7ffb6bb1d12a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:55.151505 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e3c0eea-4bba-4632-b8c9-7ffb6bb1d12a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.184448 Oct 06 11:07:55.152122 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 251/504] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:54 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:56.179138 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-76c82f53-63db-422f-ab33-461e89fec3b4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:56.180614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-76c82f53-63db-422f-ab33-461e89fec3b4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:56.186954 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76c82f53-63db-422f-ab33-461e89fec3b4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:56.187510 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76c82f53-63db-422f-ab33-461e89fec3b4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:56.188062 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76c82f53-63db-422f-ab33-461e89fec3b4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:56.188905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76c82f53-63db-422f-ab33-461e89fec3b4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:56.190682 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76c82f53-63db-422f-ab33-461e89fec3b4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:56.191632 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76c82f53-63db-422f-ab33-461e89fec3b4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:56.339294 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-76c82f53-63db-422f-ab33-461e89fec3b4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:56.348611 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-76c82f53-63db-422f-ab33-461e89fec3b4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.175372 Oct 06 11:07:56.359924 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 254/505] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:56 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:57.377585 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aad4b46f-3aa2-4c41-a036-cf6bc5c69e8d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:57.378311 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aad4b46f-3aa2-4c41-a036-cf6bc5c69e8d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:57.385367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aad4b46f-3aa2-4c41-a036-cf6bc5c69e8d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:57.386071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aad4b46f-3aa2-4c41-a036-cf6bc5c69e8d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:57.386513 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aad4b46f-3aa2-4c41-a036-cf6bc5c69e8d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:57.387223 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aad4b46f-3aa2-4c41-a036-cf6bc5c69e8d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:57.387681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aad4b46f-3aa2-4c41-a036-cf6bc5c69e8d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:57.388200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aad4b46f-3aa2-4c41-a036-cf6bc5c69e8d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:57.529554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aad4b46f-3aa2-4c41-a036-cf6bc5c69e8d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:57.539590 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aad4b46f-3aa2-4c41-a036-cf6bc5c69e8d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.166302 Oct 06 11:07:57.540423 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 252/506] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:57 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:58.152306 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f4e6ab0-343a-4cf4-ba8d-c6e035ea9e82 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:58.152907 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f4e6ab0-343a-4cf4-ba8d-c6e035ea9e82 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:58.160000 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4e6ab0-343a-4cf4-ba8d-c6e035ea9e82 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:58.160571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4e6ab0-343a-4cf4-ba8d-c6e035ea9e82 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:58.161021 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4e6ab0-343a-4cf4-ba8d-c6e035ea9e82 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:58.161715 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4e6ab0-343a-4cf4-ba8d-c6e035ea9e82 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:58.162171 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4e6ab0-343a-4cf4-ba8d-c6e035ea9e82 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:58.162600 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4e6ab0-343a-4cf4-ba8d-c6e035ea9e82 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:58.184774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f4e6ab0-343a-4cf4-ba8d-c6e035ea9e82 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/ips" status: 200 len: 151 microversion: 2.20 time: 0.036371 Oct 06 11:07:58.185370 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 255/507] 10.222.0.52 () {60 vars in 1289 bytes} [Thu Oct 6 11:07:58 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 11:07:58.563024 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61b99eb1-a2d2-4299-adec-a1bddec4cded tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:58.563638 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-61b99eb1-a2d2-4299-adec-a1bddec4cded tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:58.570459 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b99eb1-a2d2-4299-adec-a1bddec4cded tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:58.570940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b99eb1-a2d2-4299-adec-a1bddec4cded tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:58.571378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b99eb1-a2d2-4299-adec-a1bddec4cded tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:58.572125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b99eb1-a2d2-4299-adec-a1bddec4cded tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:58.572541 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b99eb1-a2d2-4299-adec-a1bddec4cded tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:58.573279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b99eb1-a2d2-4299-adec-a1bddec4cded tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:58.708870 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-61b99eb1-a2d2-4299-adec-a1bddec4cded tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:07:58.717316 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61b99eb1-a2d2-4299-adec-a1bddec4cded tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.158002 Oct 06 11:07:58.718109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 253/508] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:58 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:07:59.741899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a9f9dd1-ca45-4bbf-a8de-078c290b674a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:07:59.742508 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7a9f9dd1-ca45-4bbf-a8de-078c290b674a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:07:59.749006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a9f9dd1-ca45-4bbf-a8de-078c290b674a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:59.749491 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a9f9dd1-ca45-4bbf-a8de-078c290b674a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:59.749966 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a9f9dd1-ca45-4bbf-a8de-078c290b674a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:07:59.750651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a9f9dd1-ca45-4bbf-a8de-078c290b674a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:07:59.751099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a9f9dd1-ca45-4bbf-a8de-078c290b674a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:07:59.751516 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a9f9dd1-ca45-4bbf-a8de-078c290b674a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:00.123476 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7a9f9dd1-ca45-4bbf-a8de-078c290b674a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:00.133226 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7a9f9dd1-ca45-4bbf-a8de-078c290b674a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.395162 Oct 06 11:08:00.133800 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 256/509] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:07:59 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:00.519504 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a083fd5-e437-4084-98f8-919bf0880cc5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:08:00.520015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a083fd5-e437-4084-98f8-919bf0880cc5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:00.526652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a083fd5-e437-4084-98f8-919bf0880cc5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:00.527148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a083fd5-e437-4084-98f8-919bf0880cc5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:00.527597 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a083fd5-e437-4084-98f8-919bf0880cc5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:00.528338 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a083fd5-e437-4084-98f8-919bf0880cc5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:00.528802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a083fd5-e437-4084-98f8-919bf0880cc5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:00.529234 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a083fd5-e437-4084-98f8-919bf0880cc5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:00.555086 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-6a083fd5-e437-4084-98f8-919bf0880cc5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lazy-loading 'flavor' on Instance uuid ea9fceeb-0987-4e4f-b34b-f524fa791d3b {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:08:00.754560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a083fd5-e437-4084-98f8-919bf0880cc5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "POST /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/action" status: 202 len: 0 microversion: 2.20 time: 0.239448 Oct 06 11:08:00.755354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 254/510] 10.222.0.52 () {62 vars in 1319 bytes} [Thu Oct 6 11:08:00 2022] POST /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:08:00.764048 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:00.764897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:00.772553 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:00.773177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:00.773859 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:00.774659 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:00.775483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:00.776235 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:00.948716 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:00.957952 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:00.959390 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:00.960620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cceb85ca-4bd4-4bca-b092-67b839e6782f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.200836 Oct 06 11:08:00.961180 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 257/511] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:00 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:01.157876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3142120e-9cd3-4732-8eb9-b8a843b02aab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:01.159344 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3142120e-9cd3-4732-8eb9-b8a843b02aab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:01.165606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3142120e-9cd3-4732-8eb9-b8a843b02aab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:01.166090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3142120e-9cd3-4732-8eb9-b8a843b02aab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:01.166526 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3142120e-9cd3-4732-8eb9-b8a843b02aab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:01.167402 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3142120e-9cd3-4732-8eb9-b8a843b02aab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:01.168046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3142120e-9cd3-4732-8eb9-b8a843b02aab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:01.168698 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3142120e-9cd3-4732-8eb9-b8a843b02aab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:01.310630 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3142120e-9cd3-4732-8eb9-b8a843b02aab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:01.319617 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3142120e-9cd3-4732-8eb9-b8a843b02aab tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.165903 Oct 06 11:08:01.320439 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 255/512] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:01 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:01.988979 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:01.989776 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:01.996839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:01.997252 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:01.997840 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:01.998753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:01.999280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:01.999863 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:02.216326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:02.227282 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:02.228886 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:02.230225 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-13835e58-1856-41d5-9991-291d4f02ff5b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.246619 Oct 06 11:08:02.230775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 258/513] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:01 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:02.343373 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2dbd4786-a049-4771-aadc-ab75d8f4cb12 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:02.344030 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2dbd4786-a049-4771-aadc-ab75d8f4cb12 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:02.350893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbd4786-a049-4771-aadc-ab75d8f4cb12 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:02.351375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbd4786-a049-4771-aadc-ab75d8f4cb12 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:02.351814 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbd4786-a049-4771-aadc-ab75d8f4cb12 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:02.352604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbd4786-a049-4771-aadc-ab75d8f4cb12 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:02.353077 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbd4786-a049-4771-aadc-ab75d8f4cb12 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:02.353477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbd4786-a049-4771-aadc-ab75d8f4cb12 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:02.560179 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dbd4786-a049-4771-aadc-ab75d8f4cb12 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:02.568550 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2dbd4786-a049-4771-aadc-ab75d8f4cb12 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.229039 Oct 06 11:08:02.569120 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 256/514] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:02 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:03.256188 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:03.257115 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:03.264500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:03.265159 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:03.265748 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:03.266775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:03.267454 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:03.268571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:03.403737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:03.413110 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:03.414552 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:03.415711 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5536297-4e6d-472c-b765-9e13c9b73820 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.163936 Oct 06 11:08:03.416299 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 259/515] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:03 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:03.592816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b353762-20b4-4272-a8dd-8978021b451b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:03.593423 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b353762-20b4-4272-a8dd-8978021b451b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:03.599824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b353762-20b4-4272-a8dd-8978021b451b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:03.600335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b353762-20b4-4272-a8dd-8978021b451b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:03.600771 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b353762-20b4-4272-a8dd-8978021b451b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:03.601457 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b353762-20b4-4272-a8dd-8978021b451b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:03.601910 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b353762-20b4-4272-a8dd-8978021b451b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:03.602331 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b353762-20b4-4272-a8dd-8978021b451b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:03.729482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b353762-20b4-4272-a8dd-8978021b451b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:03.738343 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b353762-20b4-4272-a8dd-8978021b451b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.149315 Oct 06 11:08:03.738903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 257/516] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:03 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:04.199202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1565661192", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "networks": [{"uuid": "89c4ba27-8104-4fca-a158-a2b3f4c2936b"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:08:04.253040 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] validate_networks() for [('89c4ba27-8104-4fca-a158-a2b3f4c2936b', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:08:04.441127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:04.441741 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:04.447628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:04.448154 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:04.448599 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:04.449300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:04.449763 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:04.450191 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:04.580382 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:04.588598 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:04.590252 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:04.591468 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-39bca27e-ed5b-4b04-b83c-3178424308e2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.154289 Oct 06 11:08:04.592052 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 258/517] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:04 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:04.602958 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:08:04.603415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:08:04.603847 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:08:04.604283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:08:04.604692 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:08:04.614017 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:04.614428 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:04.614862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:04.615609 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:04.616098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:04.616519 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:04.633041 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Getting quotas for project 8f981425a83c4eb6a71891c756977764. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:08:04.637001 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Getting quotas for user 59074dbc0ef44686a396b6aaaf19ea25 and project 8f981425a83c4eb6a71891c756977764. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:08:04.648737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:08:04.651030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:08:04.696246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e6fe3dc-4f9a-4c80-a174-a162a60d2ab0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500674 Oct 06 11:08:04.696892 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 260/518] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:08:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:08:04.708595 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-597984c3-592d-4c39-8e74-1a4c8c9330b0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:04.709208 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-597984c3-592d-4c39-8e74-1a4c8c9330b0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:04.761805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9cf415b-fc15-4f0f-bd2e-2b537a34c6f5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:04.762420 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9cf415b-fc15-4f0f-bd2e-2b537a34c6f5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:04.766375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-597984c3-592d-4c39-8e74-1a4c8c9330b0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:04.769687 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cf415b-fc15-4f0f-bd2e-2b537a34c6f5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:04.770190 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cf415b-fc15-4f0f-bd2e-2b537a34c6f5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:04.770626 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cf415b-fc15-4f0f-bd2e-2b537a34c6f5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:04.771564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cf415b-fc15-4f0f-bd2e-2b537a34c6f5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:04.772307 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cf415b-fc15-4f0f-bd2e-2b537a34c6f5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:04.772918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cf415b-fc15-4f0f-bd2e-2b537a34c6f5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:04.775192 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-597984c3-592d-4c39-8e74-1a4c8c9330b0 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1219 microversion: 2.1 time: 0.071140 Oct 06 11:08:04.775875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 259/519] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:04 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:04.913195 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a9cf415b-fc15-4f0f-bd2e-2b537a34c6f5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:04.921571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9cf415b-fc15-4f0f-bd2e-2b537a34c6f5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.163592 Oct 06 11:08:04.922138 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 261/520] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:04 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:08:05.618187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:05.618796 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:05.625260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:05.625746 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:05.626181 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:05.626868 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:05.627895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:05.628325 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:05.755984 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:05.764033 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:05.765448 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:05.766586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-47942d2f-be76-4b19-b834-ee018b9b7d60 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.152251 Oct 06 11:08:05.767136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 260/521] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:05 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:05.798307 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7aab5900-de78-424f-a64e-3328ef22e38d tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:05.798949 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7aab5900-de78-424f-a64e-3328ef22e38d tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:05.805875 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aab5900-de78-424f-a64e-3328ef22e38d tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:05.806362 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aab5900-de78-424f-a64e-3328ef22e38d tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:05.806802 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aab5900-de78-424f-a64e-3328ef22e38d tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:05.807500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aab5900-de78-424f-a64e-3328ef22e38d tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:05.807997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aab5900-de78-424f-a64e-3328ef22e38d tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:05.808431 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aab5900-de78-424f-a64e-3328ef22e38d tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:05.872964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7aab5900-de78-424f-a64e-3328ef22e38d tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:05.880753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7aab5900-de78-424f-a64e-3328ef22e38d tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1271 microversion: 2.1 time: 0.086114 Oct 06 11:08:05.881318 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 262/522] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:05 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:05.945192 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0b22bc8-3c91-4f68-bc7e-41575998bb25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:05.945802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0b22bc8-3c91-4f68-bc7e-41575998bb25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:05.951646 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b22bc8-3c91-4f68-bc7e-41575998bb25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:05.952168 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b22bc8-3c91-4f68-bc7e-41575998bb25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:05.952608 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b22bc8-3c91-4f68-bc7e-41575998bb25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:05.953306 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b22bc8-3c91-4f68-bc7e-41575998bb25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:05.953760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b22bc8-3c91-4f68-bc7e-41575998bb25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:05.954184 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b22bc8-3c91-4f68-bc7e-41575998bb25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:06.098367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0b22bc8-3c91-4f68-bc7e-41575998bb25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:06.107219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0b22bc8-3c91-4f68-bc7e-41575998bb25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.165602 Oct 06 11:08:06.125024 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 261/523] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:05 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:08:06.792109 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:06.792716 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:06.798688 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:06.800013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:06.800356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:06.801139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:06.801588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:06.802015 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:06.903791 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-099b2952-16f0-4852-afa6-8c9b62a64708 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:06.904413 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-099b2952-16f0-4852-afa6-8c9b62a64708 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:06.911595 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099b2952-16f0-4852-afa6-8c9b62a64708 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:06.912195 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099b2952-16f0-4852-afa6-8c9b62a64708 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:06.912544 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099b2952-16f0-4852-afa6-8c9b62a64708 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:06.913261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099b2952-16f0-4852-afa6-8c9b62a64708 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:06.913659 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099b2952-16f0-4852-afa6-8c9b62a64708 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:06.914362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099b2952-16f0-4852-afa6-8c9b62a64708 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:07.002054 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:07.011045 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:07.012889 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:07.014226 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-388688b6-c606-46ec-b684-578b33eb39e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.226050 Oct 06 11:08:07.014781 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 263/524] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:06 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:07.059176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-099b2952-16f0-4852-afa6-8c9b62a64708 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:07.067239 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-099b2952-16f0-4852-afa6-8c9b62a64708 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1319 microversion: 2.1 time: 0.167308 Oct 06 11:08:07.068242 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 262/525] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:06 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:08:07.132855 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-24775365-179a-4036-bd15-3ac5cef1ad57 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:07.133641 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-24775365-179a-4036-bd15-3ac5cef1ad57 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:07.140275 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24775365-179a-4036-bd15-3ac5cef1ad57 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:07.140822 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24775365-179a-4036-bd15-3ac5cef1ad57 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:07.141350 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24775365-179a-4036-bd15-3ac5cef1ad57 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:07.142120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24775365-179a-4036-bd15-3ac5cef1ad57 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:07.142645 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24775365-179a-4036-bd15-3ac5cef1ad57 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:07.143757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24775365-179a-4036-bd15-3ac5cef1ad57 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:07.350831 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-24775365-179a-4036-bd15-3ac5cef1ad57 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:07.359095 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-24775365-179a-4036-bd15-3ac5cef1ad57 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1721 microversion: 2.1 time: 0.230516 Oct 06 11:08:07.359690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 264/526] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:07 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:07.662297 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-96da8ecc-a4df-4066-916f-bab7f2f9b270 req-155f877f-88de-4e17-baa8-5945e2cc5399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1280c81a-455c-4da8-bc99-47c47ebde1f3", "tag": "7a6321fc-4870-46cb-97a9-9107f11d074a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:08:07.672164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-96da8ecc-a4df-4066-916f-bab7f2f9b270 req-155f877f-88de-4e17-baa8-5945e2cc5399 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:07.672574 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-96da8ecc-a4df-4066-916f-bab7f2f9b270 req-155f877f-88de-4e17-baa8-5945e2cc5399 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:07.672999 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-96da8ecc-a4df-4066-916f-bab7f2f9b270 req-155f877f-88de-4e17-baa8-5945e2cc5399 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:07.684410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-96da8ecc-a4df-4066-916f-bab7f2f9b270 req-155f877f-88de-4e17-baa8-5945e2cc5399 service nova] Creating event network-changed:7a6321fc-4870-46cb-97a9-9107f11d074a for instance 1280c81a-455c-4da8-bc99-47c47ebde1f3 on hv-cinder-86020 Oct 06 11:08:07.689242 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-96da8ecc-a4df-4066-916f-bab7f2f9b270 req-155f877f-88de-4e17-baa8-5945e2cc5399 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031425 Oct 06 11:08:07.689889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 263/527] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:08:08.040548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:08.041234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:08.048183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:08.048679 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:08.049118 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:08.050026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:08.050494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:08.051880 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:08.093401 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-729b75a1-c830-4bbe-8a14-1882852b22b7 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:08.094106 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-729b75a1-c830-4bbe-8a14-1882852b22b7 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:08.101072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-729b75a1-c830-4bbe-8a14-1882852b22b7 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:08.101569 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-729b75a1-c830-4bbe-8a14-1882852b22b7 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:08.102009 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-729b75a1-c830-4bbe-8a14-1882852b22b7 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:08.102717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-729b75a1-c830-4bbe-8a14-1882852b22b7 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:08.103380 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-729b75a1-c830-4bbe-8a14-1882852b22b7 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:08.103808 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-729b75a1-c830-4bbe-8a14-1882852b22b7 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:08.225948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:08.234011 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:08.234838 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-729b75a1-c830-4bbe-8a14-1882852b22b7 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:08.237323 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:08.238691 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-67b8c7cb-a063-44ae-b53e-024419155a65 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.202081 Oct 06 11:08:08.239429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 265/528] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:08 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:08.244183 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-729b75a1-c830-4bbe-8a14-1882852b22b7 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1319 microversion: 2.1 time: 0.155129 Oct 06 11:08:08.245761 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 264/529] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:08 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:08:08.383805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-284f0b74-6d0b-4806-b555-f7eb7ed7ee24 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:08.384446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-284f0b74-6d0b-4806-b555-f7eb7ed7ee24 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:08.390493 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-284f0b74-6d0b-4806-b555-f7eb7ed7ee24 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:08.390989 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-284f0b74-6d0b-4806-b555-f7eb7ed7ee24 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:08.391426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-284f0b74-6d0b-4806-b555-f7eb7ed7ee24 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:08.392150 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-284f0b74-6d0b-4806-b555-f7eb7ed7ee24 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:08.392586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-284f0b74-6d0b-4806-b555-f7eb7ed7ee24 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:08.393575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-284f0b74-6d0b-4806-b555-f7eb7ed7ee24 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:08.609824 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-284f0b74-6d0b-4806-b555-f7eb7ed7ee24 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:08.618963 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-284f0b74-6d0b-4806-b555-f7eb7ed7ee24 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1698 microversion: 2.1 time: 0.238957 Oct 06 11:08:08.619747 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 266/530] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:08 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1698 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:08.643242 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe27ae1e-512a-4b11-ac6c-c91251df3739 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:08:08.649777 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe27ae1e-512a-4b11-ac6c-c91251df3739 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:08.650266 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe27ae1e-512a-4b11-ac6c-c91251df3739 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:08.650705 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe27ae1e-512a-4b11-ac6c-c91251df3739 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:08.713121 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe27ae1e-512a-4b11-ac6c-c91251df3739 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Going to try to start instance {{(pid=120603) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 11:08:08.757893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe27ae1e-512a-4b11-ac6c-c91251df3739 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/action" status: 202 len: 0 microversion: 2.1 time: 0.118578 Oct 06 11:08:08.758708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 265/531] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:08:08 2022] POST /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:08:08.766536 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-06a16900-685b-4c9e-9f2f-3c7819563c08 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:08.767149 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-06a16900-685b-4c9e-9f2f-3c7819563c08 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:08.773832 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06a16900-685b-4c9e-9f2f-3c7819563c08 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:08.774370 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06a16900-685b-4c9e-9f2f-3c7819563c08 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:08.774807 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06a16900-685b-4c9e-9f2f-3c7819563c08 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:08.775497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06a16900-685b-4c9e-9f2f-3c7819563c08 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:08.775976 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06a16900-685b-4c9e-9f2f-3c7819563c08 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:08.776403 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06a16900-685b-4c9e-9f2f-3c7819563c08 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:08.908938 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-06a16900-685b-4c9e-9f2f-3c7819563c08 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:08.917112 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-06a16900-685b-4c9e-9f2f-3c7819563c08 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1707 microversion: 2.1 time: 0.154386 Oct 06 11:08:08.917676 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 267/532] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:08 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1707 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:09.266279 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2dfe0cf3-1702-4a2f-9d02-3644eb655d4f tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:09.266953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:09.267330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2dfe0cf3-1702-4a2f-9d02-3644eb655d4f tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:09.267434 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:09.273881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:09.274373 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:09.274810 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:09.275306 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dfe0cf3-1702-4a2f-9d02-3644eb655d4f tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:09.275513 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:09.275789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dfe0cf3-1702-4a2f-9d02-3644eb655d4f tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:09.276010 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:09.276251 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dfe0cf3-1702-4a2f-9d02-3644eb655d4f tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:09.276437 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:09.276968 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dfe0cf3-1702-4a2f-9d02-3644eb655d4f tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:09.277416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dfe0cf3-1702-4a2f-9d02-3644eb655d4f tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:09.277869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dfe0cf3-1702-4a2f-9d02-3644eb655d4f tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:09.291208 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:09.300657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:09.417429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2dfe0cf3-1702-4a2f-9d02-3644eb655d4f tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:09.417781 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:09.426343 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2dfe0cf3-1702-4a2f-9d02-3644eb655d4f tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1319 microversion: 2.1 time: 0.163898 Oct 06 11:08:09.426497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:09.427067 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 268/533] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:09 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:08:09.428054 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:09.429218 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d66c289d-5dcb-4989-a618-e290d5714fde tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.167223 Oct 06 11:08:09.429754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 266/534] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:09 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:09.941043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-572a9fd3-65a8-4bec-8935-3e87832927ea tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:09.941578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-572a9fd3-65a8-4bec-8935-3e87832927ea tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:09.947406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-572a9fd3-65a8-4bec-8935-3e87832927ea tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:09.947949 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-572a9fd3-65a8-4bec-8935-3e87832927ea tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:09.948386 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-572a9fd3-65a8-4bec-8935-3e87832927ea tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:09.949065 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-572a9fd3-65a8-4bec-8935-3e87832927ea tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:09.949515 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-572a9fd3-65a8-4bec-8935-3e87832927ea tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:09.949950 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-572a9fd3-65a8-4bec-8935-3e87832927ea tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:10.077260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-572a9fd3-65a8-4bec-8935-3e87832927ea tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:10.087305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-572a9fd3-65a8-4bec-8935-3e87832927ea tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1707 microversion: 2.1 time: 0.150285 Oct 06 11:08:10.087896 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 269/535] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:09 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1707 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:10.449843 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d32caae3-7355-4374-aa3f-771ea25a67c2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:10.450468 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d32caae3-7355-4374-aa3f-771ea25a67c2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:10.455001 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:10.455614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:10.457051 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d32caae3-7355-4374-aa3f-771ea25a67c2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:10.457552 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d32caae3-7355-4374-aa3f-771ea25a67c2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:10.457997 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d32caae3-7355-4374-aa3f-771ea25a67c2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:10.458704 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d32caae3-7355-4374-aa3f-771ea25a67c2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:10.459171 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d32caae3-7355-4374-aa3f-771ea25a67c2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:10.459597 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d32caae3-7355-4374-aa3f-771ea25a67c2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:10.462464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:10.462950 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:10.463396 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:10.464123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:10.464581 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:10.465003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:10.587989 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d32caae3-7355-4374-aa3f-771ea25a67c2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:10.595681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d32caae3-7355-4374-aa3f-771ea25a67c2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1319 microversion: 2.1 time: 0.149600 Oct 06 11:08:10.597024 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 267/536] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:10 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:10.598471 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:10.606567 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:10.608054 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:10.609208 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9ba368e0-0cde-4259-930a-e716ad53e3e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.158259 Oct 06 11:08:10.609758 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 270/537] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:10 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:11.110647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e1d3fbd0-726b-4b41-be83-8172b9955b2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:11.111236 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e1d3fbd0-726b-4b41-be83-8172b9955b2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:11.118167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1d3fbd0-726b-4b41-be83-8172b9955b2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:11.118660 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1d3fbd0-726b-4b41-be83-8172b9955b2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:11.119098 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1d3fbd0-726b-4b41-be83-8172b9955b2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:11.119789 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1d3fbd0-726b-4b41-be83-8172b9955b2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:11.120283 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1d3fbd0-726b-4b41-be83-8172b9955b2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:11.120712 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1d3fbd0-726b-4b41-be83-8172b9955b2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:11.247032 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e1d3fbd0-726b-4b41-be83-8172b9955b2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:11.255218 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e1d3fbd0-726b-4b41-be83-8172b9955b2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1707 microversion: 2.1 time: 0.148574 Oct 06 11:08:11.255791 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 268/538] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:11 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1707 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:11.618779 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82b193e5-d86e-4f41-b7f5-db3f0c6612fe tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:11.619405 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82b193e5-d86e-4f41-b7f5-db3f0c6612fe tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:11.625806 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82b193e5-d86e-4f41-b7f5-db3f0c6612fe tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:11.626286 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82b193e5-d86e-4f41-b7f5-db3f0c6612fe tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:11.626717 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82b193e5-d86e-4f41-b7f5-db3f0c6612fe tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:11.627398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82b193e5-d86e-4f41-b7f5-db3f0c6612fe tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:11.627860 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82b193e5-d86e-4f41-b7f5-db3f0c6612fe tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:11.628283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82b193e5-d86e-4f41-b7f5-db3f0c6612fe tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:11.634478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:11.635092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:11.641430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:11.641919 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:11.642411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:11.644493 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:11.645296 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:11.645404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:11.764710 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-82b193e5-d86e-4f41-b7f5-db3f0c6612fe tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:11.773663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82b193e5-d86e-4f41-b7f5-db3f0c6612fe tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1319 microversion: 2.1 time: 0.158746 Oct 06 11:08:11.774235 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 271/539] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:11 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:11.788615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:11.796909 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:11.798370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:11.799569 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ece09822-6952-4302-ada2-cd850b592090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.169041 Oct 06 11:08:11.806832 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 269/540] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:11 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:12.279229 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d9ad182e-5936-464b-bda4-97c86004bb35 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:12.280055 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d9ad182e-5936-464b-bda4-97c86004bb35 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:12.287039 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ad182e-5936-464b-bda4-97c86004bb35 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:12.287659 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ad182e-5936-464b-bda4-97c86004bb35 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:12.288198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ad182e-5936-464b-bda4-97c86004bb35 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:12.288980 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ad182e-5936-464b-bda4-97c86004bb35 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:12.289471 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ad182e-5936-464b-bda4-97c86004bb35 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:12.289906 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ad182e-5936-464b-bda4-97c86004bb35 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:12.476832 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d9ad182e-5936-464b-bda4-97c86004bb35 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:12.485304 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d9ad182e-5936-464b-bda4-97c86004bb35 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1707 microversion: 2.1 time: 0.210136 Oct 06 11:08:12.486053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 272/541] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:12 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1707 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:12.796936 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f7f4568-116e-43c1-a3c5-9828ad04a5e2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:12.797514 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f7f4568-116e-43c1-a3c5-9828ad04a5e2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:12.804050 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7f4568-116e-43c1-a3c5-9828ad04a5e2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:12.804486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7f4568-116e-43c1-a3c5-9828ad04a5e2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:12.804971 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7f4568-116e-43c1-a3c5-9828ad04a5e2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:12.805797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7f4568-116e-43c1-a3c5-9828ad04a5e2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:12.806261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7f4568-116e-43c1-a3c5-9828ad04a5e2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:12.806691 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7f4568-116e-43c1-a3c5-9828ad04a5e2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:12.825378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:12.826121 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:12.835695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:12.836402 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:12.836839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:12.837547 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:12.837998 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:12.838419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:12.942725 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f7f4568-116e-43c1-a3c5-9828ad04a5e2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:12.950507 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f7f4568-116e-43c1-a3c5-9828ad04a5e2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1319 microversion: 2.1 time: 0.157471 Oct 06 11:08:12.951292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 270/542] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:12 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:12.972497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:12.980568 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:12.982010 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:12.983152 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8d17c6b1-2e89-4e57-af7a-35d247ff2b0b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.161689 Oct 06 11:08:12.983705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 273/543] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:12 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:13.508527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7226ad5b-c013-4666-a67a-2250fb6a5450 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:13.509145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7226ad5b-c013-4666-a67a-2250fb6a5450 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:13.515303 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7226ad5b-c013-4666-a67a-2250fb6a5450 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:13.515792 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7226ad5b-c013-4666-a67a-2250fb6a5450 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:13.516269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7226ad5b-c013-4666-a67a-2250fb6a5450 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:13.516963 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7226ad5b-c013-4666-a67a-2250fb6a5450 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:13.517528 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7226ad5b-c013-4666-a67a-2250fb6a5450 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:13.518610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7226ad5b-c013-4666-a67a-2250fb6a5450 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:13.653162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7226ad5b-c013-4666-a67a-2250fb6a5450 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:13.662045 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7226ad5b-c013-4666-a67a-2250fb6a5450 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1707 microversion: 2.1 time: 0.157359 Oct 06 11:08:13.663239 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 271/544] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:13 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1707 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:13.973871 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-886fd1ad-06b4-4751-8fca-2f6dbb3d6a89 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:13.974411 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-886fd1ad-06b4-4751-8fca-2f6dbb3d6a89 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:13.980855 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-886fd1ad-06b4-4751-8fca-2f6dbb3d6a89 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:13.981335 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-886fd1ad-06b4-4751-8fca-2f6dbb3d6a89 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:13.981769 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-886fd1ad-06b4-4751-8fca-2f6dbb3d6a89 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:13.982492 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-886fd1ad-06b4-4751-8fca-2f6dbb3d6a89 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:13.982943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-886fd1ad-06b4-4751-8fca-2f6dbb3d6a89 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:13.983366 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-886fd1ad-06b4-4751-8fca-2f6dbb3d6a89 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:14.009124 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:14.009743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:14.016076 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:14.016573 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:14.017055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:14.017793 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:14.018260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:14.018716 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:14.118804 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-886fd1ad-06b4-4751-8fca-2f6dbb3d6a89 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:14.126277 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-886fd1ad-06b4-4751-8fca-2f6dbb3d6a89 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1319 microversion: 2.1 time: 0.156802 Oct 06 11:08:14.126841 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 274/545] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:13 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:14.149730 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:14.157915 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:14.160070 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:14.161263 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb5248f6-0d6f-4a4e-bf7d-39ef78f0da18 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1743 microversion: 2.20 time: 0.156109 Oct 06 11:08:14.161819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 272/546] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:14 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:14.686364 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-458c0dae-6108-416d-b643-5d50533c6f29 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:14.686884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-458c0dae-6108-416d-b643-5d50533c6f29 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:14.688922 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:14.690359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:14.696064 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-458c0dae-6108-416d-b643-5d50533c6f29 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:14.696547 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-458c0dae-6108-416d-b643-5d50533c6f29 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:14.696980 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-458c0dae-6108-416d-b643-5d50533c6f29 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:14.697663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-458c0dae-6108-416d-b643-5d50533c6f29 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:14.698123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-458c0dae-6108-416d-b643-5d50533c6f29 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:14.698530 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-458c0dae-6108-416d-b643-5d50533c6f29 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:14.827212 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-458c0dae-6108-416d-b643-5d50533c6f29 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:14.835432 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-458c0dae-6108-416d-b643-5d50533c6f29 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1711 microversion: 2.1 time: 0.152999 Oct 06 11:08:14.836029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 275/547] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:14 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:15.150008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e61242c-5707-4dfe-a197-dfd97708ba09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:15.150624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e61242c-5707-4dfe-a197-dfd97708ba09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:15.152654 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:15.153335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=50 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:15.159951 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e61242c-5707-4dfe-a197-dfd97708ba09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:15.160438 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e61242c-5707-4dfe-a197-dfd97708ba09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:15.160878 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e61242c-5707-4dfe-a197-dfd97708ba09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:15.161570 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e61242c-5707-4dfe-a197-dfd97708ba09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:15.162024 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e61242c-5707-4dfe-a197-dfd97708ba09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:15.162449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e61242c-5707-4dfe-a197-dfd97708ba09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:15.186503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:15.187139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:15.193620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:15.194105 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:15.194547 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:15.195238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:15.195692 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:15.196146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:15.297515 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e61242c-5707-4dfe-a197-dfd97708ba09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:15.305454 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e61242c-5707-4dfe-a197-dfd97708ba09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1319 microversion: 2.1 time: 0.159615 Oct 06 11:08:15.306214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 273/548] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:15 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:15.325461 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:15.333961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:15.335397 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:15.336636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d6577caf-9d0f-42f4-8a5d-0fee7daf1af9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1743 microversion: 2.20 time: 0.153984 Oct 06 11:08:15.337194 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 276/549] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:15 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:15.839456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-27f2a87d-3811-44bb-bc1f-cb12b6fc6b4f req-fbb53b66-689f-4ed8-8d7f-658399f4f9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1280c81a-455c-4da8-bc99-47c47ebde1f3", "name": "network-vif-plugged", "status": "completed", "tag": "7a6321fc-4870-46cb-97a9-9107f11d074a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:08:15.850967 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-27f2a87d-3811-44bb-bc1f-cb12b6fc6b4f req-fbb53b66-689f-4ed8-8d7f-658399f4f9ff service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:15.851658 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-27f2a87d-3811-44bb-bc1f-cb12b6fc6b4f req-fbb53b66-689f-4ed8-8d7f-658399f4f9ff service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:15.852102 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-27f2a87d-3811-44bb-bc1f-cb12b6fc6b4f req-fbb53b66-689f-4ed8-8d7f-658399f4f9ff service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:15.868235 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-27f2a87d-3811-44bb-bc1f-cb12b6fc6b4f req-fbb53b66-689f-4ed8-8d7f-658399f4f9ff service nova] Creating event network-vif-plugged:7a6321fc-4870-46cb-97a9-9107f11d074a for instance 1280c81a-455c-4da8-bc99-47c47ebde1f3 on hv-cinder-86020 Oct 06 11:08:15.873486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-27f2a87d-3811-44bb-bc1f-cb12b6fc6b4f req-fbb53b66-689f-4ed8-8d7f-658399f4f9ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038364 Oct 06 11:08:15.874459 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 274/550] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:08:16.328019 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d22a8b17-f2d9-47cb-99e6-c3f5a1ec64fd tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:16.328630 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d22a8b17-f2d9-47cb-99e6-c3f5a1ec64fd tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:16.335990 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d22a8b17-f2d9-47cb-99e6-c3f5a1ec64fd tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:16.336470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d22a8b17-f2d9-47cb-99e6-c3f5a1ec64fd tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:16.336912 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d22a8b17-f2d9-47cb-99e6-c3f5a1ec64fd tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:16.337594 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d22a8b17-f2d9-47cb-99e6-c3f5a1ec64fd tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:16.338045 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d22a8b17-f2d9-47cb-99e6-c3f5a1ec64fd tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:16.338467 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d22a8b17-f2d9-47cb-99e6-c3f5a1ec64fd tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:16.363763 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:16.364495 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:16.371212 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:16.371807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:16.372356 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:16.373125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:16.373671 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:16.374256 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:16.473171 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d22a8b17-f2d9-47cb-99e6-c3f5a1ec64fd tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:16.480820 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d22a8b17-f2d9-47cb-99e6-c3f5a1ec64fd tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1319 microversion: 2.1 time: 0.156655 Oct 06 11:08:16.481388 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 277/551] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:16 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:16.510433 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:16.519501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:16.520992 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:16.522400 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35333074-fba4-4d69-9f1f-5849add9cbc6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1743 microversion: 2.20 time: 0.163389 Oct 06 11:08:16.522964 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 275/552] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:16 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:17.502535 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b05eb40b-4dff-4026-a752-7453e92d14f6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:17.503146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b05eb40b-4dff-4026-a752-7453e92d14f6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:17.509583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b05eb40b-4dff-4026-a752-7453e92d14f6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:17.510062 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b05eb40b-4dff-4026-a752-7453e92d14f6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:17.510495 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b05eb40b-4dff-4026-a752-7453e92d14f6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:17.511181 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b05eb40b-4dff-4026-a752-7453e92d14f6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:17.511633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b05eb40b-4dff-4026-a752-7453e92d14f6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:17.512146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b05eb40b-4dff-4026-a752-7453e92d14f6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:17.547437 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:17.548102 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:17.554983 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:17.555557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:17.556044 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:17.556750 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:17.557208 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:17.557652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:17.645604 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b05eb40b-4dff-4026-a752-7453e92d14f6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:17.661346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b05eb40b-4dff-4026-a752-7453e92d14f6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1319 microversion: 2.1 time: 0.162678 Oct 06 11:08:17.675862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 278/553] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:17 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:17.698165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:17.707242 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:17.708780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:17.709943 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0215ce08-257a-4fc2-a2e3-0e6dc491e016 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1743 microversion: 2.20 time: 0.166307 Oct 06 11:08:17.710538 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 276/554] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:17 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:17.889967 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3d3c426b-b979-46e1-b771-c6ef3e5eef6e req-95d92567-ae88-4dda-9df8-9f217cb4ff79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9fceeb-0987-4e4f-b34b-f524fa791d3b", "name": "network-vif-plugged", "status": "completed", "tag": "e16aada9-7c39-402c-9979-d8f302e4c39a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:08:17.900624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3d3c426b-b979-46e1-b771-c6ef3e5eef6e req-95d92567-ae88-4dda-9df8-9f217cb4ff79 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:17.901036 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3d3c426b-b979-46e1-b771-c6ef3e5eef6e req-95d92567-ae88-4dda-9df8-9f217cb4ff79 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:17.901466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3d3c426b-b979-46e1-b771-c6ef3e5eef6e req-95d92567-ae88-4dda-9df8-9f217cb4ff79 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:17.912282 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3d3c426b-b979-46e1-b771-c6ef3e5eef6e req-95d92567-ae88-4dda-9df8-9f217cb4ff79 service nova] Creating event network-vif-plugged:e16aada9-7c39-402c-9979-d8f302e4c39a for instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b on hv-cinder-86020 Oct 06 11:08:17.917241 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3d3c426b-b979-46e1-b771-c6ef3e5eef6e req-95d92567-ae88-4dda-9df8-9f217cb4ff79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031179 Oct 06 11:08:17.917839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 279/555] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:08:18.684958 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5cac48b7-f5c2-44b4-b52a-08052b1c6660 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:18.685518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5cac48b7-f5c2-44b4-b52a-08052b1c6660 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:18.692164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cac48b7-f5c2-44b4-b52a-08052b1c6660 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:18.692645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cac48b7-f5c2-44b4-b52a-08052b1c6660 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:18.693079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cac48b7-f5c2-44b4-b52a-08052b1c6660 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:18.693768 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cac48b7-f5c2-44b4-b52a-08052b1c6660 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:18.694218 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cac48b7-f5c2-44b4-b52a-08052b1c6660 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:18.694638 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cac48b7-f5c2-44b4-b52a-08052b1c6660 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:18.735944 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:18.737397 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:18.743504 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:18.744105 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:18.744604 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:18.745360 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:18.745886 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:18.746367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:18.826561 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5cac48b7-f5c2-44b4-b52a-08052b1c6660 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:18.834751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5cac48b7-f5c2-44b4-b52a-08052b1c6660 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1508 microversion: 2.1 time: 0.153737 Oct 06 11:08:18.835332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 277/556] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:08:18 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:08:18.879986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:18.888367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:18.889824 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:18.890988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e09a3dee-d74b-4c01-89bc-0161991d7779 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1743 microversion: 2.20 time: 0.159438 Oct 06 11:08:18.891539 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 280/557] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:18 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:19.925611 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:19.926223 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:19.932662 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:19.933155 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:19.933599 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:19.934299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:19.934761 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:19.935191 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:20.069884 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:20.078003 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:20.079447 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:20.080688 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b00edb1-74dd-48de-bd7c-e22bcc7b6eeb tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1743 microversion: 2.20 time: 0.159559 Oct 06 11:08:20.081231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 278/558] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:19 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:21.106350 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:21.107101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:21.114729 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:21.115273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:21.115649 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:21.116723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:21.116877 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:21.117359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:21.247557 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:21.257135 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:21.258905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:21.260349 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-542464f3-d407-46ba-a002-957a2f7919a1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1743 microversion: 2.20 time: 0.157699 Oct 06 11:08:21.261496 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 281/559] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:21 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:22.286418 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:22.287031 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:22.293469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:22.293961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:22.294394 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:22.295090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:22.295541 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:22.295988 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:22.439861 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:22.449181 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:22.450627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:22.451778 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8213ebb-29f8-4269-993d-03e618b32f41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1738 microversion: 2.20 time: 0.169234 Oct 06 11:08:22.452435 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 279/560] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:22 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:23.489508 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:23.490158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:23.492986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:23.504913 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:23.505677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:23.506323 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:23.507450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:23.507925 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:23.508719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:23.714841 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:23.729274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:23.731095 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:23.732290 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bcf9198d-4a2d-477f-8b1a-a09786716c07 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1738 microversion: 2.20 time: 0.258621 Oct 06 11:08:23.732849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 282/561] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:23 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:24.761849 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:24.763259 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:24.773151 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:24.773722 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:24.774415 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:24.775346 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:24.775898 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:24.776794 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:24.992021 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:25.000655 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:25.002918 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:25.004197 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70510824-0cc9-421e-a05d-53839021d7ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1738 microversion: 2.20 time: 0.246466 Oct 06 11:08:25.004971 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 280/562] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:24 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:26.031888 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:26.033246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:26.040246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:26.041124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:26.041547 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:26.042405 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:26.043006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:26.043577 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:26.189301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:26.199072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:26.202442 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:26.204861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f8e58c4-b0ec-433b-8c42-c7f9c669759a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1738 microversion: 2.20 time: 0.178226 Oct 06 11:08:26.205961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 283/563] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:26 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:27.231016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:27.231638 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:27.238578 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:27.239121 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:27.239592 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:27.240314 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:27.240767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:27.241189 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:27.414422 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:27.422593 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:27.424057 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:27.426237 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bbe2c98c-d4bd-491f-ab2a-f48fe1bf2368 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1738 microversion: 2.20 time: 0.199350 Oct 06 11:08:27.427148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 281/564] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:27 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:28.452810 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:28.453407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:28.460874 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:28.461378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:28.461820 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:28.462520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:28.462974 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:28.463586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:28.603276 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:28.612622 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:28.614084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:28.615248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-336f19a4-3365-40ba-b581-15831e9baa97 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1738 microversion: 2.20 time: 0.166891 Oct 06 11:08:28.615812 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 284/565] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:28 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:29.643419 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:29.644974 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:29.652445 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:29.653337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:29.653841 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:29.655765 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:29.656527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:29.657333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:29.801979 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:29.812048 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:29.813548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:29.814721 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-334bb224-8e25-40aa-8e9e-3130069de55d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1738 microversion: 2.20 time: 0.175807 Oct 06 11:08:29.816189 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 282/566] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:29 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:30.844150 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:30.845398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:30.853049 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:30.853544 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:30.853991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:30.854708 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:30.855163 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:30.855591 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:31.016555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:31.021483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:31.027212 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:31.028686 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:31.029844 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb93c5f4-9737-4a36-b01e-53c68c7900f8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1738 microversion: 2.20 time: 0.189848 Oct 06 11:08:31.030395 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 285/567] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:30 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:32.057025 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:32.058336 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:32.064876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:32.065424 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:32.065869 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:32.066807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:32.067465 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:32.068116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:32.212948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:32.216371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:32.224186 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:32.225620 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:32.227047 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebbf77be-f758-4f5e-84c5-af0b6dc72aff tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1738 microversion: 2.20 time: 0.174067 Oct 06 11:08:32.227666 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 283/568] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:32 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:33.254167 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:33.254804 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:33.261238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:33.261728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:33.262168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:33.262862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:33.263318 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:33.263745 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:33.391456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:33.400138 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:33.401595 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:33.402781 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-15a7a932-09fb-4119-9fd7-5c029f923b1e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1738 microversion: 2.20 time: 0.153279 Oct 06 11:08:33.403341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 286/569] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:33 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:34.428655 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:34.429268 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:34.435706 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:34.436239 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:34.436681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:34.437372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:34.437828 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:34.438256 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:34.564496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:34.573056 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:34.574512 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:34.575667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1108af7e-5b4f-4d5f-a349-5b54aaf90ed1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1720 microversion: 2.20 time: 0.151499 Oct 06 11:08:34.576268 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 284/570] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:34 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:35.602735 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:35.603340 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:35.609749 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:35.610227 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:35.610657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:35.611334 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:35.611779 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:35.612232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:35.743226 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:35.752747 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:35.755357 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:35.756560 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6877bcb4-f67d-468c-8aee-667c95890491 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1720 microversion: 2.20 time: 0.157686 Oct 06 11:08:35.757125 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 287/571] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:35 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:36.782436 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:36.783073 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:36.789974 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:36.790451 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:36.790882 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:36.791568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:36.792062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:36.792486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:36.927279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:36.935275 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:36.936745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:36.937895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2ab248ba-7c5c-4e9d-98ae-26aec24151d9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1720 microversion: 2.20 time: 0.159276 Oct 06 11:08:36.938449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 285/572] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:36 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:37.765487 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-52e7e950-5f40-4d35-80e8-d40eb0eb4cc2 req-65123be9-a9a2-4844-9e77-603327d6eb9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9fceeb-0987-4e4f-b34b-f524fa791d3b", "name": "network-vif-unplugged", "status": "completed", "tag": "e16aada9-7c39-402c-9979-d8f302e4c39a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:08:37.775890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-52e7e950-5f40-4d35-80e8-d40eb0eb4cc2 req-65123be9-a9a2-4844-9e77-603327d6eb9d service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:37.776372 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-52e7e950-5f40-4d35-80e8-d40eb0eb4cc2 req-65123be9-a9a2-4844-9e77-603327d6eb9d service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:37.776806 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-52e7e950-5f40-4d35-80e8-d40eb0eb4cc2 req-65123be9-a9a2-4844-9e77-603327d6eb9d service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:37.787610 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.compute.server_external_events [req-52e7e950-5f40-4d35-80e8-d40eb0eb4cc2 req-65123be9-a9a2-4844-9e77-603327d6eb9d service nova] Unable to find a host for instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b. Dropping event network-vif-unplugged {{(pid=120602) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 06 11:08:37.788519 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-52e7e950-5f40-4d35-80e8-d40eb0eb4cc2 req-65123be9-a9a2-4844-9e77-603327d6eb9d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026894 Oct 06 11:08:37.789094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 288/573] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 06 11:08:37.963702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:37.964286 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:37.970710 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:37.971691 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:37.972236 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:37.972935 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:37.973403 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:37.973834 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:38.103045 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:38.111017 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:38.113169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:38.114318 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c37a37de-0718-4bbe-8d00-f4bf8257c5d3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1663 microversion: 2.20 time: 0.154579 Oct 06 11:08:38.114886 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 286/574] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:37 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:38.138589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6de568e-cb34-42a2-bf99-186d635d3040 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52985e6c-73a3-452c-beb6-3e0875379dbd"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:08:38.140988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a6de568e-cb34-42a2-bf99-186d635d3040 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:38.147315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6de568e-cb34-42a2-bf99-186d635d3040 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:38.147793 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6de568e-cb34-42a2-bf99-186d635d3040 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:38.148255 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6de568e-cb34-42a2-bf99-186d635d3040 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:38.148935 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6de568e-cb34-42a2-bf99-186d635d3040 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:38.149378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6de568e-cb34-42a2-bf99-186d635d3040 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:38.149795 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6de568e-cb34-42a2-bf99-186d635d3040 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:38.428077 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6de568e-cb34-42a2-bf99-186d635d3040 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "POST /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.293350 Oct 06 11:08:38.428741 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 289/575] 10.222.0.52 () {62 vars in 1364 bytes} [Thu Oct 6 11:08:38 2022] POST /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-volume_attachments => generated 188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 11:08:38.554052 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92b09083-b812-4651-860e-67599aac09fe tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:08:38.554643 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92b09083-b812-4651-860e-67599aac09fe tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:38.560581 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b09083-b812-4651-860e-67599aac09fe tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:38.561068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b09083-b812-4651-860e-67599aac09fe tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:38.561529 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b09083-b812-4651-860e-67599aac09fe tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:38.562218 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b09083-b812-4651-860e-67599aac09fe tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:38.562665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b09083-b812-4651-860e-67599aac09fe tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:38.563305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b09083-b812-4651-860e-67599aac09fe tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:38.605677 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92b09083-b812-4651-860e-67599aac09fe tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120603) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 11:08:38.670374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92b09083-b812-4651-860e-67599aac09fe tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "POST /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/action" status: 202 len: 0 microversion: 2.20 time: 0.120171 Oct 06 11:08:38.670974 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 287/576] 10.222.0.52 () {62 vars in 1319 bytes} [Thu Oct 6 11:08:38 2022] POST /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:08:38.679469 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:38.680101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:38.686555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:38.687036 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:38.687782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:38.688176 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:38.688623 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:38.689045 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:38.823062 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:38.832367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:38.833796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:38.834983 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8395d741-0223-43fd-b1b5-7f3c91004f8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1749 microversion: 2.20 time: 0.159319 Oct 06 11:08:38.835538 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 290/577] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:38 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:39.860649 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:39.861254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:39.867594 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:39.868114 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:39.868552 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:39.869238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:39.869684 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:39.870109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:39.999447 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:40.008874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:40.010320 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:40.011468 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3f40cf14-b1e6-4944-8067-07141e3117ae tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1751 microversion: 2.20 time: 0.155238 Oct 06 11:08:40.012061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 288/578] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:39 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:41.038471 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:41.039032 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:41.045467 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:41.045953 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:41.046390 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:41.047079 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:41.047528 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:41.047980 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:41.176477 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:41.186401 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:41.187915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:41.189083 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5e6d509-1607-47e7-af21-02219d319282 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.155554 Oct 06 11:08:41.189772 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 291/579] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:41 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:42.215905 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:42.216648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:42.227315 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:42.227819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:42.228295 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:42.229011 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:42.229472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:42.229907 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:42.410391 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:42.422977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:42.424776 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:42.426138 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ffdef4be-60c4-4253-9434-cb364cbc89bc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.215056 Oct 06 11:08:42.426698 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 289/580] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:42 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:43.452073 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:43.453328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:43.461348 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:43.461841 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:43.462280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:43.462991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:43.463445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:43.463888 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:43.617358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:43.626161 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:43.627600 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:43.635775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5ea6f813-7cd1-407e-9c2f-34dbd01e36e8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.187732 Oct 06 11:08:43.636856 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 292/581] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:43 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:44.661558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:44.662212 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:44.668184 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:44.668681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:44.669125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:44.669825 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:44.670289 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:44.670717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:44.714543 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9755e887-94b6-4f03-8855-f113eb64ac7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97b1cd08-8c24-416f-927c-48cecb3c0d6e", "device": "/dev/sdb"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:08:44.718339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9755e887-94b6-4f03-8855-f113eb64ac7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:44.725995 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9755e887-94b6-4f03-8855-f113eb64ac7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:44.726499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9755e887-94b6-4f03-8855-f113eb64ac7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:44.726918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9755e887-94b6-4f03-8855-f113eb64ac7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:44.727620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9755e887-94b6-4f03-8855-f113eb64ac7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:44.728095 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9755e887-94b6-4f03-8855-f113eb64ac7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:44.728517 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9755e887-94b6-4f03-8855-f113eb64ac7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:44.859238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:44.868997 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:44.870593 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:44.871759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9d792350-313b-4161-aebd-d32905e2a409 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.214492 Oct 06 11:08:44.872474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 290/582] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:44 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:45.898129 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:45.898813 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:45.901418 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:45.906789 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:45.907280 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:45.907723 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:45.908456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:45.908917 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:45.909347 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:46.044360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:46.053347 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:46.054800 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:46.055985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60156c67-5d9f-4eb2-90c1-6fc955ab4a83 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.162040 Oct 06 11:08:46.056541 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 291/583] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:45 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:47.083720 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:47.085107 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:47.092262 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:47.092753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:47.093193 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:47.093901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:47.094354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:47.094783 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:47.238603 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:47.247951 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:47.249404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:47.250646 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-03299b0a-9127-4bf9-ad71-4298c452e746 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.172446 Oct 06 11:08:47.251499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 292/584] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:47 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:48.276939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:48.277856 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:48.285243 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:48.292203 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:48.292747 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:48.293538 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:48.294010 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:48.294433 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:48.438071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:48.448132 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:48.449589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:48.450802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c61d12ae-caba-4f5c-ada6-e558c4a8fa8d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.177707 Oct 06 11:08:48.451656 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 293/585] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:48 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:49.478156 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:49.478952 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:49.485554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:49.486041 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:49.486477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:49.487187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:49.487681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:49.488239 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:49.627641 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:49.637494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:49.638954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:49.640145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0fab271-6bdb-4ced-a727-07c502982923 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.166307 Oct 06 11:08:49.640704 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 294/586] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:49 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:50.668667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:50.669348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:50.677027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:50.677853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:50.678302 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:50.679018 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:50.679479 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:50.679939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:50.814303 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:50.824370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:50.825829 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:50.827042 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f872ebf1-492d-4e4e-95b2-fec6b5079683 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.163918 Oct 06 11:08:50.827611 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 295/587] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:50 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:08:51.853599 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:51.854209 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:51.860582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:51.861069 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:51.861510 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:51.862208 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:51.863730 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:51.864193 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:51.994136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:52.002735 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:52.004893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:52.006079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-278fecc2-cb9f-4f79-b452-63d8f1ac2090 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.156338 Oct 06 11:08:52.006710 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 296/588] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:51 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:53.032405 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:53.033081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:53.039513 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:53.040058 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:53.040519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:53.041208 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:53.041665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:53.042093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:53.173187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:53.181816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:53.183277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:53.184474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b588562f-4c6b-4384-8c97-853ffcaed714 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.156004 Oct 06 11:08:53.185022 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 297/589] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:53 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:54.210902 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:54.211572 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:54.217839 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:54.218328 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:54.218766 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:54.219458 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:54.219944 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:54.220370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:54.351318 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:54.359872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:54.361354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:54.362792 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f53bbedb-09d6-4137-845a-f86d24cfe423 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.156289 Oct 06 11:08:54.363456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 298/590] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:54 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:54.723155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=23 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:54.817993 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:55.388115 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:55.388733 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:55.395210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:55.395751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:55.396180 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:55.396890 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:55.397604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:55.398036 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:55.413163 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:55.525854 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:55.534855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:55.536333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:55.537492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd7564f6-7246-4a50-96ab-f0c3003a259c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.153436 Oct 06 11:08:55.538051 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 299/591] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:55 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:56.563734 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:56.564404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:56.571414 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:56.571924 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:56.572362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:56.573088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:56.573539 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:56.573960 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:56.704024 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:56.712762 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:56.714231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:56.715374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-be0f8317-e9d3-458e-bf96-f1fa922f395b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.155564 Oct 06 11:08:56.715948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 300/592] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:56 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:57.741421 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:57.742048 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:57.748459 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:57.748936 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:57.749365 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:57.750047 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:57.750496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:57.750912 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:57.876872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:57.886016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:57.887581 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:57.888760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a59e64a6-23c2-423c-8c6d-64ef3430b1e7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.151356 Oct 06 11:08:57.889318 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 301/593] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:57 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:08:58.732748 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9755e887-94b6-4f03-8855-f113eb64ac7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "POST /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.022490 Oct 06 11:08:58.733472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 293/594] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:08:44 2022] POST /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3/os-volume_attachments => generated 194 bytes in 14024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:08:58.914452 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:08:58.915599 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:08:58.922273 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:58.922768 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:58.923213 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:58.923944 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:08:58.924411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:08:58.924843 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:08:59.113193 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:59.121883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:59.123330 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:08:59.124518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e6382db-6217-4448-93bd-252695929cf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.213956 Oct 06 11:08:59.125072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 302/595] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:08:58 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:00.152434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:00.153130 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:00.159182 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:00.159661 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:00.160119 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:00.160803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:00.161254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:00.161677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:00.339971 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:00.348386 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:00.350102 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:00.351254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be8f53cd-b59f-4d4b-a91e-101ee3fde573 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.203564 Oct 06 11:09:00.351819 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 294/596] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:00 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:01.378108 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:01.378715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:01.385340 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:01.385817 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:01.386248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:01.386935 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:01.387384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:01.387806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:01.514619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:01.523811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:01.525274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:01.526417 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97da4722-bc97-4ca4-aa4c-025a55f24b41 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.152296 Oct 06 11:09:01.526971 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 303/597] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:01 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:02.551062 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:02.552234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:02.558581 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:02.559090 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:02.559529 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:02.560247 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:02.560706 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:02.561165 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:02.691362 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:02.700136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:02.701588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:02.702750 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a5c0c617-4832-4c19-b52a-c3f0f4a70496 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.155547 Oct 06 11:09:02.703338 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 295/598] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:02 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:03.728576 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:03.729182 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:03.735695 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:03.736242 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:03.736679 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:03.737375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:03.737827 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:03.738253 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:03.869726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:03.878432 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:03.880613 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:03.882121 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6cac1fe-5a8b-463d-b90c-9006ebcd607f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.157418 Oct 06 11:09:03.882685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 304/599] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:03 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:04.907651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:04.908312 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:04.915244 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:04.915731 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:04.916218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:04.916914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:04.917372 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:04.917799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:05.043762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:05.052959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:05.054405 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:05.055591 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-68888645-1355-4add-bd10-0dd192b8b2a0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.151821 Oct 06 11:09:05.056183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 296/600] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:04 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:06.081640 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:06.082448 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:06.089871 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:06.090400 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:06.090840 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:06.091546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:06.092046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:06.092477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:06.219368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:06.228019 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:06.229447 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:06.230589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b13a3cb-70aa-4981-a875-5778c0649cc1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.152885 Oct 06 11:09:06.231138 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 305/601] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:06 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:07.256818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:07.257441 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:07.263821 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:07.264335 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:07.264774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:07.265498 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:07.265954 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:07.266381 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:07.425815 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:07.435350 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:07.436855 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:07.438048 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc7b5dc7-949e-408a-9025-b16b7b02a1b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.185381 Oct 06 11:09:07.438602 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 297/602] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:07 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:07.892889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-4c0f5701-e59a-4984-a44c-2472debc7545 req-c964e7b9-465d-4310-9166-98a2ec53f4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9fceeb-0987-4e4f-b34b-f524fa791d3b", "name": "network-vif-plugged", "status": "completed", "tag": "e16aada9-7c39-402c-9979-d8f302e4c39a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:09:07.904149 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4c0f5701-e59a-4984-a44c-2472debc7545 req-c964e7b9-465d-4310-9166-98a2ec53f4cf service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:07.904642 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4c0f5701-e59a-4984-a44c-2472debc7545 req-c964e7b9-465d-4310-9166-98a2ec53f4cf service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:07.905074 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4c0f5701-e59a-4984-a44c-2472debc7545 req-c964e7b9-465d-4310-9166-98a2ec53f4cf service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:07.916388 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-4c0f5701-e59a-4984-a44c-2472debc7545 req-c964e7b9-465d-4310-9166-98a2ec53f4cf service nova] Creating event network-vif-plugged:e16aada9-7c39-402c-9979-d8f302e4c39a for instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b on hv-cinder-86020 Oct 06 11:09:07.921328 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-4c0f5701-e59a-4984-a44c-2472debc7545 req-c964e7b9-465d-4310-9166-98a2ec53f4cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 Oct 06 11:09:07.921939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 306/603] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:09:08.464883 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:08.465499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:08.471918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:08.472402 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:08.472838 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:08.473617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:08.474317 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:08.474773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:08.604171 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:08.612652 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:08.614600 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:08.615742 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7414496-3aea-4ced-b545-c20b6348041d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.154873 Oct 06 11:09:08.616326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 298/604] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:08 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:09.641760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:09.642382 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:09.649413 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:09.649894 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:09.650327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:09.651015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:09.651467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:09.651914 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:09.778391 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:09.786926 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:09.788417 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:09.789602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-05e2cfc2-40bd-4021-b8cb-0a2078d65962 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.152721 Oct 06 11:09:09.790165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 307/605] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:09 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:10.816132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:10.816655 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:10.823497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:10.824014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:10.824459 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:10.825148 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:10.825604 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:10.826029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:10.952718 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:10.962393 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:10.963850 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:10.965002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-12dbff7d-718a-4111-ba6f-adf74ebdab9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.152976 Oct 06 11:09:10.965554 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 299/606] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:10 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:11.990170 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:11.990760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:11.996850 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:11.997641 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:11.998075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:11.998994 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:11.999454 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:11.999986 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:12.127607 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:12.136702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:12.138132 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:12.139275 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6c4e00c1-41dc-411f-a173-33b5901cc41e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.153489 Oct 06 11:09:12.139881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 308/607] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:11 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:13.167103 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 11:09:13.167701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Thu Oct 6 11:09:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b (ip 10.222.0.52) !!! Oct 06 11:09:13.269058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:13.269667 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:13.276400 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:13.276910 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:13.277341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:13.278020 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:13.278467 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:13.278888 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:13.408618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:13.417782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:13.419164 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:13.420354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a2e37979-d44c-4e96-9949-6aaa720821a8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.259462 Oct 06 11:09:13.420907 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 300/608] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:13 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:14.446845 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:14.447802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:14.454271 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:14.454752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:14.455194 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:14.455912 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:14.456370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:14.456801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:14.587070 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:14.595599 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:14.597083 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:14.598293 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e64af4e0-f66e-4daf-996d-b0eabc18440c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.155959 Oct 06 11:09:14.598938 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 309/609] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:14 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:15.624270 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:15.624875 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:15.631194 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:15.631824 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:15.632286 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:15.632968 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:15.633414 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:15.633865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:15.766360 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:15.775857 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:15.777309 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:15.778466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-42eb6d46-5efc-4f38-9668-17fa5114d235 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.158068 Oct 06 11:09:15.779030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 301/610] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:15 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:16.805010 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:16.805659 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:16.808353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=38 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:16.813724 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:16.814214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:16.814657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:16.815357 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:16.815819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:16.816290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:16.948404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:16.957029 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:16.958565 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:16.960914 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3702937a-b2e9-4429-9964-5e8be69d37c7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.160203 Oct 06 11:09:16.961477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 310/611] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:16 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:17.264162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6aa4e6e6-e1f1-4704-9707-8891e65a17af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0289f0d5-27cd-497e-a6a1-365b34b1fb4d"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:09:17.266561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6aa4e6e6-e1f1-4704-9707-8891e65a17af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:17.272762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6aa4e6e6-e1f1-4704-9707-8891e65a17af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:17.273237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6aa4e6e6-e1f1-4704-9707-8891e65a17af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:17.273669 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6aa4e6e6-e1f1-4704-9707-8891e65a17af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:17.274348 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6aa4e6e6-e1f1-4704-9707-8891e65a17af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:17.274797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6aa4e6e6-e1f1-4704-9707-8891e65a17af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:17.275217 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6aa4e6e6-e1f1-4704-9707-8891e65a17af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:17.986286 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:17.986929 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:17.994513 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:17.995009 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:17.995447 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:17.996235 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:17.996692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:17.997120 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:18.126350 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:18.134780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:18.136248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:18.137401 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-092b4133-f3f7-4d25-a5f3-f8dabe7cb2e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.154923 Oct 06 11:09:18.137960 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 311/612] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:17 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:09:18.616595 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6aa4e6e6-e1f1-4704-9707-8891e65a17af tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.453151 Oct 06 11:09:18.617188 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 302/613] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:09:17 2022] POST /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments => generated 194 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:09:19.163409 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:19.165125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:19.173430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:19.174120 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:19.175266 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:19.176093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:19.176727 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:19.177378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:19.316515 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:19.326818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:19.328437 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:19.329608 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ba73d83-b68c-4c49-b055-171773681ce2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.171099 Oct 06 11:09:19.330167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 312/614] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:19 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:20.356908 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:20.357603 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:20.363652 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:20.364164 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:20.364598 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:20.365766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:20.366336 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:20.366761 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:20.494564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:20.503121 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:20.504608 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:20.505754 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1059e563-8733-4516-a72d-d7ab6712bea1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.153533 Oct 06 11:09:20.507005 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 303/615] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:20 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:09:21.532046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:21.532654 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:21.539529 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:21.540055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:21.540492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:21.541179 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:21.541630 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:21.542052 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:21.668485 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:21.676990 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:21.678562 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:21.680309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-491e2336-d2a7-4c5c-b0c8-a5a8a2bc4297 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.151610 Oct 06 11:09:21.680309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 313/616] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:21 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:22.705145 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:22.705695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:22.712700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:22.713180 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:22.713617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:22.714300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:22.714748 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:22.715166 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:22.846379 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:22.855784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:22.857190 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:22.858349 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0fc1ec9-aa3f-49e4-9f48-70dd85269eb8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.157183 Oct 06 11:09:22.858899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 304/617] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:22 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:23.884669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:23.885286 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:23.892004 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:23.892676 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:23.893026 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:23.893876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:23.894469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:23.894897 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:24.049839 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:24.059361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:24.061116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:24.062289 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29190a9f-74a2-4583-bcab-25339e2a6620 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1807 microversion: 2.20 time: 0.182272 Oct 06 11:09:24.063251 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 314/618] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:23 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:25.089524 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:25.090152 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:25.092599 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=23 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:25.097940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:25.098427 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:25.098861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:25.100079 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:25.100541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:25.100964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:25.103678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:25.236075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:25.246018 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:25.247563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:25.248829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-856ea2c1-8087-4f47-929c-285d2f373a03 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1794 microversion: 2.20 time: 0.163727 Oct 06 11:09:25.249243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 305/619] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:09:25 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1794 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:09:28.672783 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d68aa4a-1b2f-477f-97c1-08266f61734a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:28.673292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d68aa4a-1b2f-477f-97c1-08266f61734a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:28.680883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d68aa4a-1b2f-477f-97c1-08266f61734a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:28.681373 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d68aa4a-1b2f-477f-97c1-08266f61734a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:28.681811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d68aa4a-1b2f-477f-97c1-08266f61734a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:28.682508 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d68aa4a-1b2f-477f-97c1-08266f61734a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:28.682968 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d68aa4a-1b2f-477f-97c1-08266f61734a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:28.683395 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d68aa4a-1b2f-477f-97c1-08266f61734a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:28.712368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=90 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:28.811478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-3d68aa4a-1b2f-477f-97c1-08266f61734a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lazy-loading 'services' on Instance uuid 1280c81a-455c-4da8-bc99-47c47ebde1f3 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:09:28.926133 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d68aa4a-1b2f-477f-97c1-08266f61734a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3/os-volume_attachments/97b1cd08-8c24-416f-927c-48cecb3c0d6e" status: 202 len: 0 microversion: 2.1 time: 0.257023 Oct 06 11:09:28.926855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 315/620] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:09:28 2022] DELETE /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3/os-volume_attachments/97b1cd08-8c24-416f-927c-48cecb3c0d6e => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:09:32.533802 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c197987-627d-4106-9f82-f63db6f60286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:09:32.536450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c197987-627d-4106-9f82-f63db6f60286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:32.543916 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c197987-627d-4106-9f82-f63db6f60286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:32.544403 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c197987-627d-4106-9f82-f63db6f60286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:32.544838 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c197987-627d-4106-9f82-f63db6f60286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:32.545526 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c197987-627d-4106-9f82-f63db6f60286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:32.545976 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c197987-627d-4106-9f82-f63db6f60286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:32.546398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c197987-627d-4106-9f82-f63db6f60286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:32.569698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-5c197987-627d-4106-9f82-f63db6f60286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lazy-loading 'flavor' on Instance uuid c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:09:32.692062 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c197987-627d-4106-9f82-f63db6f60286 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/action" status: 200 len: 32 microversion: 2.1 time: 0.163337 Oct 06 11:09:32.692678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 306/621] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:09:32 2022] POST /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 11:09:32.703616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-58e98e69-c09e-4048-9cac-ba0db469da80 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:32.704349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-58e98e69-c09e-4048-9cac-ba0db469da80 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:32.712205 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58e98e69-c09e-4048-9cac-ba0db469da80 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:32.712697 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58e98e69-c09e-4048-9cac-ba0db469da80 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:32.713142 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58e98e69-c09e-4048-9cac-ba0db469da80 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:32.713846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58e98e69-c09e-4048-9cac-ba0db469da80 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:32.714313 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58e98e69-c09e-4048-9cac-ba0db469da80 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:32.714737 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58e98e69-c09e-4048-9cac-ba0db469da80 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:32.926058 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-58e98e69-c09e-4048-9cac-ba0db469da80 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:32.934520 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-58e98e69-c09e-4048-9cac-ba0db469da80 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.235179 Oct 06 11:09:32.935089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 316/622] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:32 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:33.227477 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37dcc79c-f653-4e63-b212-6f9df17eb318 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:33.228188 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37dcc79c-f653-4e63-b212-6f9df17eb318 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:33.234286 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dcc79c-f653-4e63-b212-6f9df17eb318 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:33.234860 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dcc79c-f653-4e63-b212-6f9df17eb318 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:33.235363 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dcc79c-f653-4e63-b212-6f9df17eb318 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:33.236145 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dcc79c-f653-4e63-b212-6f9df17eb318 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:33.236662 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dcc79c-f653-4e63-b212-6f9df17eb318 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:33.237153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dcc79c-f653-4e63-b212-6f9df17eb318 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:33.263288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37dcc79c-f653-4e63-b212-6f9df17eb318 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:09:33.338094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37dcc79c-f653-4e63-b212-6f9df17eb318 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 204 len: 0 microversion: 2.1 time: 0.114726 Oct 06 11:09:33.341945 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 307/623] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:09:33 2022] DELETE /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:09:33.348116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa0b420c-f0b2-40c8-ae7f-65935b645cd5 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:33.349090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa0b420c-f0b2-40c8-ae7f-65935b645cd5 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:33.357076 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa0b420c-f0b2-40c8-ae7f-65935b645cd5 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:33.357561 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa0b420c-f0b2-40c8-ae7f-65935b645cd5 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:33.358001 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa0b420c-f0b2-40c8-ae7f-65935b645cd5 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:33.358769 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa0b420c-f0b2-40c8-ae7f-65935b645cd5 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:33.359220 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa0b420c-f0b2-40c8-ae7f-65935b645cd5 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:33.359638 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa0b420c-f0b2-40c8-ae7f-65935b645cd5 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:33.487188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa0b420c-f0b2-40c8-ae7f-65935b645cd5 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:33.495704 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa0b420c-f0b2-40c8-ae7f-65935b645cd5 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1514 microversion: 2.1 time: 0.152522 Oct 06 11:09:33.496361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 317/624] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:33 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:33.958593 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-026d2252-4536-45c7-91e3-9e763f0c74b3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:33.959753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-026d2252-4536-45c7-91e3-9e763f0c74b3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:33.966282 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-026d2252-4536-45c7-91e3-9e763f0c74b3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:33.966758 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-026d2252-4536-45c7-91e3-9e763f0c74b3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:33.967191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-026d2252-4536-45c7-91e3-9e763f0c74b3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:33.967897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-026d2252-4536-45c7-91e3-9e763f0c74b3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:33.968349 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-026d2252-4536-45c7-91e3-9e763f0c74b3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:33.968768 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-026d2252-4536-45c7-91e3-9e763f0c74b3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:34.097016 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-026d2252-4536-45c7-91e3-9e763f0c74b3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:34.105795 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-026d2252-4536-45c7-91e3-9e763f0c74b3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.151462 Oct 06 11:09:34.106355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 308/625] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:33 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:34.518181 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80948e96-4424-4724-b54e-4fb25f730fdb tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:34.518789 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-80948e96-4424-4724-b54e-4fb25f730fdb tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:34.525508 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80948e96-4424-4724-b54e-4fb25f730fdb tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:34.525990 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80948e96-4424-4724-b54e-4fb25f730fdb tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:34.526421 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80948e96-4424-4724-b54e-4fb25f730fdb tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:34.527107 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80948e96-4424-4724-b54e-4fb25f730fdb tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:34.527556 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80948e96-4424-4724-b54e-4fb25f730fdb tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:34.528016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80948e96-4424-4724-b54e-4fb25f730fdb tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:34.657596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-80948e96-4424-4724-b54e-4fb25f730fdb tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:34.665313 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-80948e96-4424-4724-b54e-4fb25f730fdb tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1514 microversion: 2.1 time: 0.150953 Oct 06 11:09:34.665872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 318/626] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:34 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:35.129111 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8928d839-deea-4f95-b215-83b981706fc2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:35.129722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8928d839-deea-4f95-b215-83b981706fc2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:35.136387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8928d839-deea-4f95-b215-83b981706fc2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:35.136865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8928d839-deea-4f95-b215-83b981706fc2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:35.137294 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8928d839-deea-4f95-b215-83b981706fc2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:35.137987 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8928d839-deea-4f95-b215-83b981706fc2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:35.138437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8928d839-deea-4f95-b215-83b981706fc2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:35.138857 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8928d839-deea-4f95-b215-83b981706fc2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:35.267249 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8928d839-deea-4f95-b215-83b981706fc2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:35.276373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8928d839-deea-4f95-b215-83b981706fc2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.151179 Oct 06 11:09:35.276942 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 309/627] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:35 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:35.688877 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61dd0c86-dcf3-4cac-b848-e5baf005ea17 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:35.689438 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-61dd0c86-dcf3-4cac-b848-e5baf005ea17 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:35.696615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61dd0c86-dcf3-4cac-b848-e5baf005ea17 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:35.697106 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61dd0c86-dcf3-4cac-b848-e5baf005ea17 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:35.697546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61dd0c86-dcf3-4cac-b848-e5baf005ea17 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:35.698251 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61dd0c86-dcf3-4cac-b848-e5baf005ea17 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:35.698711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61dd0c86-dcf3-4cac-b848-e5baf005ea17 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:35.699141 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61dd0c86-dcf3-4cac-b848-e5baf005ea17 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:35.907491 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-61dd0c86-dcf3-4cac-b848-e5baf005ea17 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:35.915699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61dd0c86-dcf3-4cac-b848-e5baf005ea17 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 200 len: 1514 microversion: 2.1 time: 0.230724 Oct 06 11:09:35.916360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 319/628] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:35 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:36.083564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-cfd6d161-af71-49b5-a280-d77ec0b9ec50 req-2709e682-b7cf-4d93-9906-8e75a7a25b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1280c81a-455c-4da8-bc99-47c47ebde1f3", "name": "network-vif-deleted", "tag": "7a6321fc-4870-46cb-97a9-9107f11d074a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:09:36.093588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cfd6d161-af71-49b5-a280-d77ec0b9ec50 req-2709e682-b7cf-4d93-9906-8e75a7a25b25 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:36.094324 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cfd6d161-af71-49b5-a280-d77ec0b9ec50 req-2709e682-b7cf-4d93-9906-8e75a7a25b25 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:36.094943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cfd6d161-af71-49b5-a280-d77ec0b9ec50 req-2709e682-b7cf-4d93-9906-8e75a7a25b25 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:36.106180 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-cfd6d161-af71-49b5-a280-d77ec0b9ec50 req-2709e682-b7cf-4d93-9906-8e75a7a25b25 service nova] Creating event network-vif-deleted:7a6321fc-4870-46cb-97a9-9107f11d074a for instance 1280c81a-455c-4da8-bc99-47c47ebde1f3 on hv-cinder-86020 Oct 06 11:09:36.111014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-cfd6d161-af71-49b5-a280-d77ec0b9ec50 req-2709e682-b7cf-4d93-9906-8e75a7a25b25 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031574 Oct 06 11:09:36.111821 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 310/629] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:09:36.303094 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-348525d3-9ebc-41ce-ae26-63405670e3ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:36.304204 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-348525d3-9ebc-41ce-ae26-63405670e3ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:36.309753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-348525d3-9ebc-41ce-ae26-63405670e3ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:36.310236 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-348525d3-9ebc-41ce-ae26-63405670e3ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:36.310672 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-348525d3-9ebc-41ce-ae26-63405670e3ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:36.311357 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-348525d3-9ebc-41ce-ae26-63405670e3ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:36.311816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-348525d3-9ebc-41ce-ae26-63405670e3ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:36.312257 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-348525d3-9ebc-41ce-ae26-63405670e3ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:36.446307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-348525d3-9ebc-41ce-ae26-63405670e3ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:36.454469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-348525d3-9ebc-41ce-ae26-63405670e3ff tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.155807 Oct 06 11:09:36.455027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 320/630] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:36 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:36.940642 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:36.941398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: 1280c81a-455c-4da8-bc99-47c47ebde1f3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:36.948454 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:36.948940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:36.949376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:36.950067 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:36.950514 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:36.950932 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:36.964091 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] HTTP exception thrown: Instance 1280c81a-455c-4da8-bc99-47c47ebde1f3 could not be found. Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Request method failure captured: Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 HTTP/1.1 Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrcSdLOf2CCYKX0t2jKHGCgk0KUtS1v74S9Q3QXs6vE5DoRgZ7TRRnx1v-d3DeAZQDaMOc1cx3maoVBLQ3Z4X-gvq1-A88gOVj2glaipQIve-7bk_YRcVicMdsxdn_74OcXkyh7QRELbVAsbkTT4EREuP8NGA7klw-0ItIMXQf81RBw Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 8f981425a83c4eb6a71891c756977764 Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesSnapshotTestJSON-236485130 Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:09:36.965845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f981425a83c4eb6a71891c756977764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f981425a83c4eb6a71891c756977764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f981425a83c4eb6a71891c756977764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f981425a83c4eb6a71891c756977764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-VolumesSnapshotTestJSON-236485130 Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 8f981425a83c4eb6a71891c756977764 Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-236485130 Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-VolumesSnapshotTestJSON-236485130-project Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 59074dbc0ef44686a396b6aaaf19ea25 Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-VolumesSnapshotTestJSON-236485130-project Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 1280c81a-455c-4da8-bc99-47c47ebde1f3 could not be found. Oct 06 11:09:36.967456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '1280c81a-455c-4da8-bc99-47c47ebde1f3'} Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1280c81a-455c-4da8-bc99-47c47ebde1f3 could not be found. Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:09:36.968346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1280c81a-455c-4da8-bc99-47c47ebde1f3 could not be found. Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1280c81a-455c-4da8-bc99-47c47ebde1f3 could not be found. Oct 06 11:09:36.969928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:09:36.971673 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Returning 404 to user: Instance 1280c81a-455c-4da8-bc99-47c47ebde1f3 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:09:36.971673 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d532ae1-89b2-4c28-9d22-40ec3387bcf8 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3" status: 404 len: 111 microversion: 2.1 time: 0.031757 Oct 06 11:09:36.971673 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 311/631] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:36 2022] GET /compute/v2.1/servers/1280c81a-455c-4da8-bc99-47c47ebde1f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:09:37.478514 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d2905ec-d706-47d5-bd1a-d29928d6499a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:37.479118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d2905ec-d706-47d5-bd1a-d29928d6499a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:37.485440 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d2905ec-d706-47d5-bd1a-d29928d6499a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:37.485920 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d2905ec-d706-47d5-bd1a-d29928d6499a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:37.486384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d2905ec-d706-47d5-bd1a-d29928d6499a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:37.487188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d2905ec-d706-47d5-bd1a-d29928d6499a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:37.487672 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d2905ec-d706-47d5-bd1a-d29928d6499a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:37.488122 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d2905ec-d706-47d5-bd1a-d29928d6499a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:37.616986 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d2905ec-d706-47d5-bd1a-d29928d6499a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:37.625025 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d2905ec-d706-47d5-bd1a-d29928d6499a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.151007 Oct 06 11:09:37.625589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 321/632] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:37 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:38.648756 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f04f7d73-9870-4823-b24c-33138e97a710 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:38.649379 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f04f7d73-9870-4823-b24c-33138e97a710 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:38.655690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f04f7d73-9870-4823-b24c-33138e97a710 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:38.656203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f04f7d73-9870-4823-b24c-33138e97a710 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:38.656636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f04f7d73-9870-4823-b24c-33138e97a710 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:38.657324 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f04f7d73-9870-4823-b24c-33138e97a710 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:38.657773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f04f7d73-9870-4823-b24c-33138e97a710 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:38.658225 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f04f7d73-9870-4823-b24c-33138e97a710 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:38.784915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f04f7d73-9870-4823-b24c-33138e97a710 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:38.793483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f04f7d73-9870-4823-b24c-33138e97a710 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.149116 Oct 06 11:09:38.794075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 312/633] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:38 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:39.817379 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca517618-cd52-43f7-88e8-18131f046ac9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:39.817995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca517618-cd52-43f7-88e8-18131f046ac9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:39.825246 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca517618-cd52-43f7-88e8-18131f046ac9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:39.825733 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca517618-cd52-43f7-88e8-18131f046ac9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:39.826175 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca517618-cd52-43f7-88e8-18131f046ac9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:39.826871 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca517618-cd52-43f7-88e8-18131f046ac9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:39.827327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca517618-cd52-43f7-88e8-18131f046ac9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:39.827752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca517618-cd52-43f7-88e8-18131f046ac9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:39.953255 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ca517618-cd52-43f7-88e8-18131f046ac9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:39.961800 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca517618-cd52-43f7-88e8-18131f046ac9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.148277 Oct 06 11:09:39.962374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 322/634] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:39 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:40.985023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cbc16eee-751f-4365-b796-eceaedbde489 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:40.985634 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cbc16eee-751f-4365-b796-eceaedbde489 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:40.992031 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbc16eee-751f-4365-b796-eceaedbde489 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:40.992510 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbc16eee-751f-4365-b796-eceaedbde489 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:40.992943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbc16eee-751f-4365-b796-eceaedbde489 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:40.993630 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbc16eee-751f-4365-b796-eceaedbde489 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:40.994076 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbc16eee-751f-4365-b796-eceaedbde489 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:40.994517 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbc16eee-751f-4365-b796-eceaedbde489 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:41.127218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cbc16eee-751f-4365-b796-eceaedbde489 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:41.135889 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cbc16eee-751f-4365-b796-eceaedbde489 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.154747 Oct 06 11:09:41.136466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 313/635] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:40 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:42.160090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aac9600d-437f-429b-8875-7c011797c17b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:42.160713 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aac9600d-437f-429b-8875-7c011797c17b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:42.168047 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac9600d-437f-429b-8875-7c011797c17b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:42.168525 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac9600d-437f-429b-8875-7c011797c17b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:42.168970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac9600d-437f-429b-8875-7c011797c17b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:42.169672 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac9600d-437f-429b-8875-7c011797c17b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:42.170135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac9600d-437f-429b-8875-7c011797c17b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:42.170565 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac9600d-437f-429b-8875-7c011797c17b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:42.300713 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aac9600d-437f-429b-8875-7c011797c17b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:42.309677 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aac9600d-437f-429b-8875-7c011797c17b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.153461 Oct 06 11:09:42.310269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 323/636] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:42 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:43.333139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3053fb2-d5c1-4683-b625-73246380064d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:43.333769 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3053fb2-d5c1-4683-b625-73246380064d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:43.340516 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3053fb2-d5c1-4683-b625-73246380064d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:43.341000 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3053fb2-d5c1-4683-b625-73246380064d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:43.341431 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3053fb2-d5c1-4683-b625-73246380064d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:43.342108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3053fb2-d5c1-4683-b625-73246380064d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:43.342555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3053fb2-d5c1-4683-b625-73246380064d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:43.342978 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3053fb2-d5c1-4683-b625-73246380064d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:43.470528 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3053fb2-d5c1-4683-b625-73246380064d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:43.479453 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3053fb2-d5c1-4683-b625-73246380064d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.150163 Oct 06 11:09:43.480044 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 314/637] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:43 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:44.501977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f40528e6-f604-4454-abad-23c223f9dd9a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:44.502583 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f40528e6-f604-4454-abad-23c223f9dd9a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:44.508825 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f40528e6-f604-4454-abad-23c223f9dd9a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:44.509310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f40528e6-f604-4454-abad-23c223f9dd9a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:44.509747 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f40528e6-f604-4454-abad-23c223f9dd9a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:44.510430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f40528e6-f604-4454-abad-23c223f9dd9a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:44.510894 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f40528e6-f604-4454-abad-23c223f9dd9a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:44.511299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f40528e6-f604-4454-abad-23c223f9dd9a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:44.636481 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f40528e6-f604-4454-abad-23c223f9dd9a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:44.644756 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f40528e6-f604-4454-abad-23c223f9dd9a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.146512 Oct 06 11:09:44.645261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 324/638] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:44 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:45.670363 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-52c1bbce-0f42-42ba-a583-b0b127190716 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:45.670881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-52c1bbce-0f42-42ba-a583-b0b127190716 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:45.677327 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c1bbce-0f42-42ba-a583-b0b127190716 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:45.677807 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c1bbce-0f42-42ba-a583-b0b127190716 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:45.678243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c1bbce-0f42-42ba-a583-b0b127190716 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:45.679569 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c1bbce-0f42-42ba-a583-b0b127190716 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:45.680052 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c1bbce-0f42-42ba-a583-b0b127190716 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:45.680473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c1bbce-0f42-42ba-a583-b0b127190716 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:45.809095 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-52c1bbce-0f42-42ba-a583-b0b127190716 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:45.817324 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-52c1bbce-0f42-42ba-a583-b0b127190716 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.150840 Oct 06 11:09:45.817892 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 315/639] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:45 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:46.840962 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14371f24-f486-47e0-a26c-854c293777f4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:46.841582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14371f24-f486-47e0-a26c-854c293777f4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:46.844042 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=30 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:46.849182 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14371f24-f486-47e0-a26c-854c293777f4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:46.849666 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14371f24-f486-47e0-a26c-854c293777f4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:46.850105 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14371f24-f486-47e0-a26c-854c293777f4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:46.851460 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14371f24-f486-47e0-a26c-854c293777f4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:46.851958 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14371f24-f486-47e0-a26c-854c293777f4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:46.852388 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14371f24-f486-47e0-a26c-854c293777f4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:46.979524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-14371f24-f486-47e0-a26c-854c293777f4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:46.988682 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14371f24-f486-47e0-a26c-854c293777f4 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.151566 Oct 06 11:09:46.989443 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 325/640] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:46 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:48.013095 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0c9e769-af08-4d38-9acf-4ee0ffe26c36 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:48.013716 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0c9e769-af08-4d38-9acf-4ee0ffe26c36 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:48.020095 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0c9e769-af08-4d38-9acf-4ee0ffe26c36 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:48.020860 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0c9e769-af08-4d38-9acf-4ee0ffe26c36 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:48.021309 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0c9e769-af08-4d38-9acf-4ee0ffe26c36 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:48.022253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0c9e769-af08-4d38-9acf-4ee0ffe26c36 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:48.022710 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0c9e769-af08-4d38-9acf-4ee0ffe26c36 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:48.023140 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0c9e769-af08-4d38-9acf-4ee0ffe26c36 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:48.153876 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0c9e769-af08-4d38-9acf-4ee0ffe26c36 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:48.162354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0c9e769-af08-4d38-9acf-4ee0ffe26c36 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.153080 Oct 06 11:09:48.162955 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 316/641] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:48 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:09:48.873860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1120837005", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "networks": [{"uuid": "89c4ba27-8104-4fca-a158-a2b3f4c2936b"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:09:48.927105 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] validate_networks() for [('89c4ba27-8104-4fca-a158-a2b3f4c2936b', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:09:49.185723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c5bd9e8-0299-4d70-a1af-bf4fb61e963b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:49.186258 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c5bd9e8-0299-4d70-a1af-bf4fb61e963b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:49.192806 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5bd9e8-0299-4d70-a1af-bf4fb61e963b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:49.193301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5bd9e8-0299-4d70-a1af-bf4fb61e963b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:49.193747 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5bd9e8-0299-4d70-a1af-bf4fb61e963b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:49.194950 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5bd9e8-0299-4d70-a1af-bf4fb61e963b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:49.195410 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5bd9e8-0299-4d70-a1af-bf4fb61e963b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:49.195850 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5bd9e8-0299-4d70-a1af-bf4fb61e963b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:49.331904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5c5bd9e8-0299-4d70-a1af-bf4fb61e963b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:49.340881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c5bd9e8-0299-4d70-a1af-bf4fb61e963b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.159150 Oct 06 11:09:49.341462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 317/642] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:49 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:09:49.563081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:09:49.563510 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:09:49.564030 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:09:49.564444 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:09:49.564858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:09:49.574755 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:49.575240 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:49.575677 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:49.576461 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:49.576922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:49.577353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:49.594186 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Getting quotas for project 8f981425a83c4eb6a71891c756977764. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:09:49.598127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Getting quotas for user 59074dbc0ef44686a396b6aaaf19ea25 and project 8f981425a83c4eb6a71891c756977764. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:09:49.609697 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:09:49.612046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:09:49.659109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4182a347-8c7f-4816-82cc-77f964800be2 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788943 Oct 06 11:09:49.659756 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 326/643] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:09:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:09:49.670901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-48a12985-28c0-4f4f-ae2f-d1131f08274b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:49.671627 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-48a12985-28c0-4f4f-ae2f-d1131f08274b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:49.729653 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-48a12985-28c0-4f4f-ae2f-d1131f08274b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:49.736390 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-48a12985-28c0-4f4f-ae2f-d1131f08274b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1219 microversion: 2.1 time: 0.069385 Oct 06 11:09:49.736954 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 318/644] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:49 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:50.364438 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b15b43fa-c05b-4121-a03d-1626e8c6083d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:50.365071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b15b43fa-c05b-4121-a03d-1626e8c6083d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:50.372489 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15b43fa-c05b-4121-a03d-1626e8c6083d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:50.372986 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15b43fa-c05b-4121-a03d-1626e8c6083d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:50.373467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15b43fa-c05b-4121-a03d-1626e8c6083d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:50.374175 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15b43fa-c05b-4121-a03d-1626e8c6083d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:50.374638 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15b43fa-c05b-4121-a03d-1626e8c6083d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:50.375071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b15b43fa-c05b-4121-a03d-1626e8c6083d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:50.508501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b15b43fa-c05b-4121-a03d-1626e8c6083d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:50.516866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b15b43fa-c05b-4121-a03d-1626e8c6083d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.156827 Oct 06 11:09:50.517437 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 327/645] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:50 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:09:50.759314 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1cb77e0e-15db-48d4-ade0-e9e320130b60 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:50.759947 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1cb77e0e-15db-48d4-ade0-e9e320130b60 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:50.766296 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cb77e0e-15db-48d4-ade0-e9e320130b60 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:50.766798 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cb77e0e-15db-48d4-ade0-e9e320130b60 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:50.767206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cb77e0e-15db-48d4-ade0-e9e320130b60 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:50.767984 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cb77e0e-15db-48d4-ade0-e9e320130b60 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:50.768436 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cb77e0e-15db-48d4-ade0-e9e320130b60 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:50.768865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cb77e0e-15db-48d4-ade0-e9e320130b60 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:50.829440 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1cb77e0e-15db-48d4-ade0-e9e320130b60 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:50.837160 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1cb77e0e-15db-48d4-ade0-e9e320130b60 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1271 microversion: 2.1 time: 0.081872 Oct 06 11:09:50.837721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 319/646] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:50 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:09:51.541501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bcbd73d5-43cc-4e64-890d-69d27fd4fea9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:51.542118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bcbd73d5-43cc-4e64-890d-69d27fd4fea9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:51.549740 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcbd73d5-43cc-4e64-890d-69d27fd4fea9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:51.550231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcbd73d5-43cc-4e64-890d-69d27fd4fea9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:51.550669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcbd73d5-43cc-4e64-890d-69d27fd4fea9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:51.551551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcbd73d5-43cc-4e64-890d-69d27fd4fea9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:51.552041 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcbd73d5-43cc-4e64-890d-69d27fd4fea9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:51.552467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcbd73d5-43cc-4e64-890d-69d27fd4fea9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:51.751471 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bcbd73d5-43cc-4e64-890d-69d27fd4fea9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:51.760804 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bcbd73d5-43cc-4e64-890d-69d27fd4fea9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.223878 Oct 06 11:09:51.761379 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 328/647] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:51 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:51.861333 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8c3d9f7-d483-4251-ae2f-142a4223f8c1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:51.861959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8c3d9f7-d483-4251-ae2f-142a4223f8c1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:51.868436 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8c3d9f7-d483-4251-ae2f-142a4223f8c1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:51.868926 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8c3d9f7-d483-4251-ae2f-142a4223f8c1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:51.869367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8c3d9f7-d483-4251-ae2f-142a4223f8c1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:51.870150 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8c3d9f7-d483-4251-ae2f-142a4223f8c1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:51.870613 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8c3d9f7-d483-4251-ae2f-142a4223f8c1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:51.871037 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8c3d9f7-d483-4251-ae2f-142a4223f8c1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:51.885986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:52.003248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8c3d9f7-d483-4251-ae2f-142a4223f8c1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:52.011199 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a8c3d9f7-d483-4251-ae2f-142a4223f8c1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.153783 Oct 06 11:09:52.011765 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 320/648] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:51 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:52.477348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-55c17fe0-1e9f-4e54-90c0-0863c154546e req-93ce9eab-dde2-4ea0-a252-17436b392e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e6d241-c477-4909-b878-c122be3ee91e", "tag": "8f99a7a0-4a65-4113-aaa9-dbcdf5a716b2"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:09:52.486890 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-55c17fe0-1e9f-4e54-90c0-0863c154546e req-93ce9eab-dde2-4ea0-a252-17436b392e50 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:52.487378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-55c17fe0-1e9f-4e54-90c0-0863c154546e req-93ce9eab-dde2-4ea0-a252-17436b392e50 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:52.487815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-55c17fe0-1e9f-4e54-90c0-0863c154546e req-93ce9eab-dde2-4ea0-a252-17436b392e50 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:52.498909 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-55c17fe0-1e9f-4e54-90c0-0863c154546e req-93ce9eab-dde2-4ea0-a252-17436b392e50 service nova] Creating event network-changed:8f99a7a0-4a65-4113-aaa9-dbcdf5a716b2 for instance b5e6d241-c477-4909-b878-c122be3ee91e on hv-cinder-86020 Oct 06 11:09:52.503603 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-55c17fe0-1e9f-4e54-90c0-0863c154546e req-93ce9eab-dde2-4ea0-a252-17436b392e50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087296 Oct 06 11:09:52.504207 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 329/649] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:09:52.785441 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4cb32169-ddca-4639-8c24-27c352a809f1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:52.786051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4cb32169-ddca-4639-8c24-27c352a809f1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:52.792657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cb32169-ddca-4639-8c24-27c352a809f1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:52.793140 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cb32169-ddca-4639-8c24-27c352a809f1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:52.793571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cb32169-ddca-4639-8c24-27c352a809f1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:52.794255 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cb32169-ddca-4639-8c24-27c352a809f1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:52.794704 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cb32169-ddca-4639-8c24-27c352a809f1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:52.795126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cb32169-ddca-4639-8c24-27c352a809f1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:52.927654 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4cb32169-ddca-4639-8c24-27c352a809f1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:52.936548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4cb32169-ddca-4639-8c24-27c352a809f1 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.154963 Oct 06 11:09:52.937108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 321/650] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:52 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:53.035597 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df5e2f53-fa24-479e-8c86-cf127a60f365 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:53.036277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df5e2f53-fa24-479e-8c86-cf127a60f365 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:53.043247 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df5e2f53-fa24-479e-8c86-cf127a60f365 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:53.043726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df5e2f53-fa24-479e-8c86-cf127a60f365 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:53.044252 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df5e2f53-fa24-479e-8c86-cf127a60f365 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:53.044939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df5e2f53-fa24-479e-8c86-cf127a60f365 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:53.045389 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df5e2f53-fa24-479e-8c86-cf127a60f365 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:53.045810 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df5e2f53-fa24-479e-8c86-cf127a60f365 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:53.176695 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df5e2f53-fa24-479e-8c86-cf127a60f365 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:53.185443 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df5e2f53-fa24-479e-8c86-cf127a60f365 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.154499 Oct 06 11:09:53.186005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 330/651] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:53 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:53.958782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a5da54ef-cb75-49d8-a199-6b9418e0e4da tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:53.959308 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a5da54ef-cb75-49d8-a199-6b9418e0e4da tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:53.965793 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5da54ef-cb75-49d8-a199-6b9418e0e4da tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:53.966279 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5da54ef-cb75-49d8-a199-6b9418e0e4da tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:53.966721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5da54ef-cb75-49d8-a199-6b9418e0e4da tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:53.967417 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5da54ef-cb75-49d8-a199-6b9418e0e4da tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:53.967892 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5da54ef-cb75-49d8-a199-6b9418e0e4da tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:53.968321 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5da54ef-cb75-49d8-a199-6b9418e0e4da tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:54.094675 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5da54ef-cb75-49d8-a199-6b9418e0e4da tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:54.103080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a5da54ef-cb75-49d8-a199-6b9418e0e4da tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.148143 Oct 06 11:09:54.103644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 322/652] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:53 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:54.207794 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10bc2631-7e5b-4703-9fdc-2ccc5e853bd6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:54.208426 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10bc2631-7e5b-4703-9fdc-2ccc5e853bd6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:54.215453 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10bc2631-7e5b-4703-9fdc-2ccc5e853bd6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:54.215862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10bc2631-7e5b-4703-9fdc-2ccc5e853bd6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:54.216309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10bc2631-7e5b-4703-9fdc-2ccc5e853bd6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:54.216999 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10bc2631-7e5b-4703-9fdc-2ccc5e853bd6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:54.217453 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10bc2631-7e5b-4703-9fdc-2ccc5e853bd6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:54.217873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10bc2631-7e5b-4703-9fdc-2ccc5e853bd6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:54.342264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-10bc2631-7e5b-4703-9fdc-2ccc5e853bd6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:54.349724 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10bc2631-7e5b-4703-9fdc-2ccc5e853bd6 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.145738 Oct 06 11:09:54.350289 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 331/653] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:54 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:55.126634 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e49a874-2542-4eeb-a9e9-1ff5b78eb801 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:55.127254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e49a874-2542-4eeb-a9e9-1ff5b78eb801 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:55.129699 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:55.135707 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e49a874-2542-4eeb-a9e9-1ff5b78eb801 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:55.136219 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e49a874-2542-4eeb-a9e9-1ff5b78eb801 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:55.136662 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e49a874-2542-4eeb-a9e9-1ff5b78eb801 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:55.137352 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e49a874-2542-4eeb-a9e9-1ff5b78eb801 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:55.137809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e49a874-2542-4eeb-a9e9-1ff5b78eb801 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:55.138236 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e49a874-2542-4eeb-a9e9-1ff5b78eb801 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:55.267945 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5e49a874-2542-4eeb-a9e9-1ff5b78eb801 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:55.276437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e49a874-2542-4eeb-a9e9-1ff5b78eb801 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1735 microversion: 2.1 time: 0.153832 Oct 06 11:09:55.277003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 323/654] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:55 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:55.373647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4d21d1f-ec2d-4f34-b4cf-beeb795ea23e tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:55.374264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4d21d1f-ec2d-4f34-b4cf-beeb795ea23e tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:55.380738 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d21d1f-ec2d-4f34-b4cf-beeb795ea23e tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:55.381226 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d21d1f-ec2d-4f34-b4cf-beeb795ea23e tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:55.381672 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d21d1f-ec2d-4f34-b4cf-beeb795ea23e tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:55.382371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d21d1f-ec2d-4f34-b4cf-beeb795ea23e tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:55.382830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d21d1f-ec2d-4f34-b4cf-beeb795ea23e tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:55.383261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d21d1f-ec2d-4f34-b4cf-beeb795ea23e tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:55.398414 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:55.518825 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4d21d1f-ec2d-4f34-b4cf-beeb795ea23e tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:55.527405 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4d21d1f-ec2d-4f34-b4cf-beeb795ea23e tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.157609 Oct 06 11:09:55.527986 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 332/655] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:55 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:09:56.299562 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3dcef0f2-737b-4830-a639-e2e1cad0292b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:56.300203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3dcef0f2-737b-4830-a639-e2e1cad0292b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:56.307124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dcef0f2-737b-4830-a639-e2e1cad0292b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:56.307605 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dcef0f2-737b-4830-a639-e2e1cad0292b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:56.308079 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dcef0f2-737b-4830-a639-e2e1cad0292b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:56.308769 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dcef0f2-737b-4830-a639-e2e1cad0292b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:56.309224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dcef0f2-737b-4830-a639-e2e1cad0292b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:56.309648 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3dcef0f2-737b-4830-a639-e2e1cad0292b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:56.437992 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3dcef0f2-737b-4830-a639-e2e1cad0292b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:56.446136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3dcef0f2-737b-4830-a639-e2e1cad0292b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1715 microversion: 2.1 time: 0.150431 Oct 06 11:09:56.447460 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 324/656] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:56 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:56.507677 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:56.508200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:56.515202 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:56.515761 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:56.516246 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:56.516952 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:56.517415 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:56.517857 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:56.550803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49639578-f061-4bf7-aef5-1fe22afe1888 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:56.551413 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49639578-f061-4bf7-aef5-1fe22afe1888 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:56.558175 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49639578-f061-4bf7-aef5-1fe22afe1888 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:56.558657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49639578-f061-4bf7-aef5-1fe22afe1888 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:56.559098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49639578-f061-4bf7-aef5-1fe22afe1888 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:56.559783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49639578-f061-4bf7-aef5-1fe22afe1888 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:56.560264 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49639578-f061-4bf7-aef5-1fe22afe1888 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:56.560685 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49639578-f061-4bf7-aef5-1fe22afe1888 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:56.600893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] HTTP exception thrown: Cannot 'detach_volume' instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a while it is in vm_state rescued Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Request method failure captured: Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments/0289f0d5-27cd-497e-a6a1-365b34b1fb4d HTTP/1.1 Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrYu0enH4vmsKaJVbdYN_HXF96VpdOfcnSPVjuOyC1wHfnVf-P5CdJP_RhW1d5ghD_rC7x0bdbKgaYHfMIElHsj8h1NA1rTfAWXvAIerZh8U8vsnNP1tXgQcEtSqpkhXEfWvyuSjFOkqhXel7QtylouArs23P4CdP8S_7KApeM7ViKk Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 4ebb258de32f40c68f86e4b401efde5d Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:09:56.602519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 4ebb258de32f40c68f86e4b401efde5d Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-1763361212-project Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: f1815cf2b3f347eb8276769cc30cf116 Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1763361212-project Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:09:56.604685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Cannot 'detach_volume' instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a while it is in vm_state rescued Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'server_id': 'c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a', 'id': '0289f0d5-27cd-497e-a6a1-365b34b1fb4d'} Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:09:56.605378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a while it is in vm_state rescued Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a while it is in vm_state rescued Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:09:56.607059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Returning 409 to user: Cannot 'detach_volume' instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a while it is in vm_state rescued {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:09:56.608987 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b469268-d37a-43c5-8211-36393b7a8717 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments/0289f0d5-27cd-497e-a6a1-365b34b1fb4d" status: 409 len: 152 microversion: 2.1 time: 0.101229 Oct 06 11:09:56.608987 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 333/657] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:09:56 2022] DELETE /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments/0289f0d5-27cd-497e-a6a1-365b34b1fb4d => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 11:09:56.613501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d224c3a-ef54-4ed8-afb5-3998363a9bb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:09:56.614039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d224c3a-ef54-4ed8-afb5-3998363a9bb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:56.623461 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d224c3a-ef54-4ed8-afb5-3998363a9bb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:56.623994 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d224c3a-ef54-4ed8-afb5-3998363a9bb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:56.624497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d224c3a-ef54-4ed8-afb5-3998363a9bb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:56.625213 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d224c3a-ef54-4ed8-afb5-3998363a9bb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:56.625706 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d224c3a-ef54-4ed8-afb5-3998363a9bb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:56.626138 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d224c3a-ef54-4ed8-afb5-3998363a9bb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:56.694533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d224c3a-ef54-4ed8-afb5-3998363a9bb2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "POST /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/action" status: 202 len: 0 microversion: 2.1 time: 0.084480 Oct 06 11:09:56.694749 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-49639578-f061-4bf7-aef5-1fe22afe1888 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:56.695871 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 334/658] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:09:56 2022] POST /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 11:09:56.702477 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49639578-f061-4bf7-aef5-1fe22afe1888 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.155775 Oct 06 11:09:56.703032 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 325/659] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:56 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:09:56.703827 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19372c95-69d8-47ad-bc6f-b2b685bf7d62 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:56.704557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-19372c95-69d8-47ad-bc6f-b2b685bf7d62 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:56.710649 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19372c95-69d8-47ad-bc6f-b2b685bf7d62 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:56.711135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19372c95-69d8-47ad-bc6f-b2b685bf7d62 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:56.711573 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19372c95-69d8-47ad-bc6f-b2b685bf7d62 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:56.712471 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19372c95-69d8-47ad-bc6f-b2b685bf7d62 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:56.713153 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19372c95-69d8-47ad-bc6f-b2b685bf7d62 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:56.713459 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19372c95-69d8-47ad-bc6f-b2b685bf7d62 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:56.839818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-19372c95-69d8-47ad-bc6f-b2b685bf7d62 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:56.848011 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19372c95-69d8-47ad-bc6f-b2b685bf7d62 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1723 microversion: 2.1 time: 0.148213 Oct 06 11:09:56.848569 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 335/660] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:56 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:09:57.151918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d3395ec3-2fad-4a4b-b94b-4535ad1c3de7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:57.152417 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d3395ec3-2fad-4a4b-b94b-4535ad1c3de7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:57.158161 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3395ec3-2fad-4a4b-b94b-4535ad1c3de7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:57.158642 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3395ec3-2fad-4a4b-b94b-4535ad1c3de7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:57.159075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3395ec3-2fad-4a4b-b94b-4535ad1c3de7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:57.159757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3395ec3-2fad-4a4b-b94b-4535ad1c3de7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:57.160260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3395ec3-2fad-4a4b-b94b-4535ad1c3de7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:57.160682 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3395ec3-2fad-4a4b-b94b-4535ad1c3de7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:57.280582 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-d3395ec3-2fad-4a4b-b94b-4535ad1c3de7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lazy-loading 'services' on Instance uuid 3eb86039-b159-435a-b022-4396a59b657c {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:09:57.395017 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d3395ec3-2fad-4a4b-b94b-4535ad1c3de7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/os-volume_attachments/86c055e4-6c29-42e1-b9ed-8b9acf185618" status: 202 len: 0 microversion: 2.1 time: 0.350573 Oct 06 11:09:57.399046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 326/661] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:09:57 2022] DELETE /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/os-volume_attachments/86c055e4-6c29-42e1-b9ed-8b9acf185618 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:09:57.725028 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b0d0c26-a105-4552-b99b-053d96e92b0b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:57.725643 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b0d0c26-a105-4552-b99b-053d96e92b0b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:57.733462 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b0d0c26-a105-4552-b99b-053d96e92b0b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:57.733959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b0d0c26-a105-4552-b99b-053d96e92b0b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:57.734404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b0d0c26-a105-4552-b99b-053d96e92b0b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:57.735110 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b0d0c26-a105-4552-b99b-053d96e92b0b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:57.735577 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b0d0c26-a105-4552-b99b-053d96e92b0b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:57.736068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b0d0c26-a105-4552-b99b-053d96e92b0b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:57.864367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b0d0c26-a105-4552-b99b-053d96e92b0b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:57.872008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b0d0c26-a105-4552-b99b-053d96e92b0b tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.150769 Oct 06 11:09:57.872399 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5bcc87b3-5ff6-4e34-bc60-72fd7048c33f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:57.872852 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 336/662] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:57 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:57.873097 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5bcc87b3-5ff6-4e34-bc60-72fd7048c33f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:57.879101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bcc87b3-5ff6-4e34-bc60-72fd7048c33f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:57.879577 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bcc87b3-5ff6-4e34-bc60-72fd7048c33f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:57.880039 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bcc87b3-5ff6-4e34-bc60-72fd7048c33f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:57.880737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bcc87b3-5ff6-4e34-bc60-72fd7048c33f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:57.881185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bcc87b3-5ff6-4e34-bc60-72fd7048c33f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:57.881603 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bcc87b3-5ff6-4e34-bc60-72fd7048c33f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:58.011777 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5bcc87b3-5ff6-4e34-bc60-72fd7048c33f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:58.019979 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5bcc87b3-5ff6-4e34-bc60-72fd7048c33f tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1723 microversion: 2.1 time: 0.151911 Oct 06 11:09:58.020548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 327/663] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:57 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:09:58.894534 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe4bcf5b-f2be-476d-a517-c6311d3c3250 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:58.895181 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe4bcf5b-f2be-476d-a517-c6311d3c3250 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:58.901927 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe4bcf5b-f2be-476d-a517-c6311d3c3250 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:58.902417 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe4bcf5b-f2be-476d-a517-c6311d3c3250 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:58.902859 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe4bcf5b-f2be-476d-a517-c6311d3c3250 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:58.903612 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe4bcf5b-f2be-476d-a517-c6311d3c3250 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:58.904055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe4bcf5b-f2be-476d-a517-c6311d3c3250 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:58.904485 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe4bcf5b-f2be-476d-a517-c6311d3c3250 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:59.044532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6eeb3307-527c-4799-ad15-ee57be0b692a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:59.045843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6eeb3307-527c-4799-ad15-ee57be0b692a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:59.052424 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6eeb3307-527c-4799-ad15-ee57be0b692a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:59.052918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6eeb3307-527c-4799-ad15-ee57be0b692a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:59.053359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6eeb3307-527c-4799-ad15-ee57be0b692a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:59.054063 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6eeb3307-527c-4799-ad15-ee57be0b692a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:59.054515 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6eeb3307-527c-4799-ad15-ee57be0b692a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:59.054935 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6eeb3307-527c-4799-ad15-ee57be0b692a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:59.077985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe4bcf5b-f2be-476d-a517-c6311d3c3250 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:59.085534 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe4bcf5b-f2be-476d-a517-c6311d3c3250 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.194884 Oct 06 11:09:59.086095 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 337/664] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:58 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:09:59.195265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6eeb3307-527c-4799-ad15-ee57be0b692a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:59.203731 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6eeb3307-527c-4799-ad15-ee57be0b692a tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1723 microversion: 2.1 time: 0.163877 Oct 06 11:09:59.204344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 328/665] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:59 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:09:59.581227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-305bb781-06fe-4f4a-8b84-2441ce6dc9d0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:09:59.584272 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:59.588613 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305bb781-06fe-4f4a-8b84-2441ce6dc9d0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:59.589100 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305bb781-06fe-4f4a-8b84-2441ce6dc9d0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:59.589531 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305bb781-06fe-4f4a-8b84-2441ce6dc9d0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:59.605564 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:59.612212 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-305bb781-06fe-4f4a-8b84-2441ce6dc9d0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Going to try to stop instance {{(pid=120603) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 11:09:59.654885 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-305bb781-06fe-4f4a-8b84-2441ce6dc9d0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/action" status: 202 len: 0 microversion: 2.1 time: 0.077269 Oct 06 11:09:59.655855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 338/666] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:09:59 2022] POST /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:09:59.663894 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03cdc1a7-ece4-4077-9dbb-273d208685dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:09:59.664596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-03cdc1a7-ece4-4077-9dbb-273d208685dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:09:59.670913 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03cdc1a7-ece4-4077-9dbb-273d208685dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:59.671337 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03cdc1a7-ece4-4077-9dbb-273d208685dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:59.671820 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03cdc1a7-ece4-4077-9dbb-273d208685dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:59.672499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03cdc1a7-ece4-4077-9dbb-273d208685dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:09:59.672950 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03cdc1a7-ece4-4077-9dbb-273d208685dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:09:59.673376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03cdc1a7-ece4-4077-9dbb-273d208685dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:09:59.734404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:59.801301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-03cdc1a7-ece4-4077-9dbb-273d208685dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:09:59.808944 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-03cdc1a7-ece4-4077-9dbb-273d208685dc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.148901 Oct 06 11:09:59.809516 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 329/667] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:09:59 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:00.109849 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8a1b4d0f-75f0-4200-a7d3-c465dd5d45ca tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:00.110549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8a1b4d0f-75f0-4200-a7d3-c465dd5d45ca tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:00.117390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a1b4d0f-75f0-4200-a7d3-c465dd5d45ca tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:00.117876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a1b4d0f-75f0-4200-a7d3-c465dd5d45ca tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:00.118959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a1b4d0f-75f0-4200-a7d3-c465dd5d45ca tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:00.120009 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a1b4d0f-75f0-4200-a7d3-c465dd5d45ca tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:00.120482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a1b4d0f-75f0-4200-a7d3-c465dd5d45ca tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:00.120908 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a1b4d0f-75f0-4200-a7d3-c465dd5d45ca tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:00.227523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5be62a41-731b-45c1-a8e2-cc5bde64d90b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:00.228517 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5be62a41-731b-45c1-a8e2-cc5bde64d90b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:00.234896 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be62a41-731b-45c1-a8e2-cc5bde64d90b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:00.235386 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be62a41-731b-45c1-a8e2-cc5bde64d90b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:00.235827 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be62a41-731b-45c1-a8e2-cc5bde64d90b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:00.236599 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be62a41-731b-45c1-a8e2-cc5bde64d90b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:00.237061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be62a41-731b-45c1-a8e2-cc5bde64d90b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:00.237489 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be62a41-731b-45c1-a8e2-cc5bde64d90b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:00.262455 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8a1b4d0f-75f0-4200-a7d3-c465dd5d45ca tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:00.270226 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8a1b4d0f-75f0-4200-a7d3-c465dd5d45ca tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.164567 Oct 06 11:10:00.270791 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 339/668] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:00 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:00.364915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5be62a41-731b-45c1-a8e2-cc5bde64d90b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:00.374281 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5be62a41-731b-45c1-a8e2-cc5bde64d90b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1723 microversion: 2.1 time: 0.150610 Oct 06 11:10:00.374849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 330/669] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:00 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:00.832776 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-732e45d6-0985-43a7-9b7f-72af8e5836c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:00.833297 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-732e45d6-0985-43a7-9b7f-72af8e5836c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:00.839771 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732e45d6-0985-43a7-9b7f-72af8e5836c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:00.840286 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732e45d6-0985-43a7-9b7f-72af8e5836c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:00.840726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732e45d6-0985-43a7-9b7f-72af8e5836c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:00.841411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732e45d6-0985-43a7-9b7f-72af8e5836c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:00.841863 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732e45d6-0985-43a7-9b7f-72af8e5836c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:00.842285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-732e45d6-0985-43a7-9b7f-72af8e5836c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:00.967220 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-732e45d6-0985-43a7-9b7f-72af8e5836c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:00.974785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-732e45d6-0985-43a7-9b7f-72af8e5836c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.145961 Oct 06 11:10:00.975346 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 340/670] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:00 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:01.294534 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1f2ae1d-fdb3-4a1b-8ec6-ecdf29429de1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:01.295984 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1f2ae1d-fdb3-4a1b-8ec6-ecdf29429de1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:01.302745 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f2ae1d-fdb3-4a1b-8ec6-ecdf29429de1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:01.303400 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f2ae1d-fdb3-4a1b-8ec6-ecdf29429de1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:01.304052 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f2ae1d-fdb3-4a1b-8ec6-ecdf29429de1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:01.305089 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f2ae1d-fdb3-4a1b-8ec6-ecdf29429de1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:01.305617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f2ae1d-fdb3-4a1b-8ec6-ecdf29429de1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:01.306037 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f2ae1d-fdb3-4a1b-8ec6-ecdf29429de1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:01.397869 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-347d40fc-3a1e-41f5-b2de-dce56762bc95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:01.398486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-347d40fc-3a1e-41f5-b2de-dce56762bc95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:01.405892 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-347d40fc-3a1e-41f5-b2de-dce56762bc95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:01.406392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-347d40fc-3a1e-41f5-b2de-dce56762bc95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:01.406839 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-347d40fc-3a1e-41f5-b2de-dce56762bc95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:01.407555 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-347d40fc-3a1e-41f5-b2de-dce56762bc95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:01.408050 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-347d40fc-3a1e-41f5-b2de-dce56762bc95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:01.408625 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-347d40fc-3a1e-41f5-b2de-dce56762bc95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:01.449311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1f2ae1d-fdb3-4a1b-8ec6-ecdf29429de1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:01.457114 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1f2ae1d-fdb3-4a1b-8ec6-ecdf29429de1 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.167529 Oct 06 11:10:01.457705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 331/671] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:01 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:01.539079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-347d40fc-3a1e-41f5-b2de-dce56762bc95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:01.547431 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-347d40fc-3a1e-41f5-b2de-dce56762bc95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1723 microversion: 2.1 time: 0.153937 Oct 06 11:10:01.547946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 341/672] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:01 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:02.000125 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eea3e4c2-0670-42c3-83e3-bba6340fec71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:02.000741 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eea3e4c2-0670-42c3-83e3-bba6340fec71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:02.006629 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eea3e4c2-0670-42c3-83e3-bba6340fec71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:02.007113 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eea3e4c2-0670-42c3-83e3-bba6340fec71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:02.007504 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-98652cc9-92c2-4bda-8c85-d9fb4e18ae88 req-22f220dd-6619-44e2-9710-b621ee57f3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e6d241-c477-4909-b878-c122be3ee91e", "name": "network-vif-plugged", "status": "completed", "tag": "8f99a7a0-4a65-4113-aaa9-dbcdf5a716b2"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:10:02.007666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eea3e4c2-0670-42c3-83e3-bba6340fec71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:02.008248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eea3e4c2-0670-42c3-83e3-bba6340fec71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:02.008697 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eea3e4c2-0670-42c3-83e3-bba6340fec71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:02.009367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eea3e4c2-0670-42c3-83e3-bba6340fec71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:02.018936 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-98652cc9-92c2-4bda-8c85-d9fb4e18ae88 req-22f220dd-6619-44e2-9710-b621ee57f3fb service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:02.019852 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-98652cc9-92c2-4bda-8c85-d9fb4e18ae88 req-22f220dd-6619-44e2-9710-b621ee57f3fb service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:02.020303 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-98652cc9-92c2-4bda-8c85-d9fb4e18ae88 req-22f220dd-6619-44e2-9710-b621ee57f3fb service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:02.031916 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-98652cc9-92c2-4bda-8c85-d9fb4e18ae88 req-22f220dd-6619-44e2-9710-b621ee57f3fb service nova] Creating event network-vif-plugged:8f99a7a0-4a65-4113-aaa9-dbcdf5a716b2 for instance b5e6d241-c477-4909-b878-c122be3ee91e on hv-cinder-86020 Oct 06 11:10:02.037016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-98652cc9-92c2-4bda-8c85-d9fb4e18ae88 req-22f220dd-6619-44e2-9710-b621ee57f3fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033832 Oct 06 11:10:02.037918 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 342/673] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:10:02.141985 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-eea3e4c2-0670-42c3-83e3-bba6340fec71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:02.151423 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eea3e4c2-0670-42c3-83e3-bba6340fec71 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.155160 Oct 06 11:10:02.152028 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 332/674] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:01 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:02.480679 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0d9c4def-f2a7-476b-888f-110a69e0a5a3 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:02.481409 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0d9c4def-f2a7-476b-888f-110a69e0a5a3 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:02.487926 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d9c4def-f2a7-476b-888f-110a69e0a5a3 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:02.488412 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d9c4def-f2a7-476b-888f-110a69e0a5a3 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:02.488846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d9c4def-f2a7-476b-888f-110a69e0a5a3 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:02.489534 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d9c4def-f2a7-476b-888f-110a69e0a5a3 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:02.489985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d9c4def-f2a7-476b-888f-110a69e0a5a3 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:02.490408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d9c4def-f2a7-476b-888f-110a69e0a5a3 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:02.571889 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-627f9001-5df9-4de2-9761-2c319f322e55 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:02.572523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-627f9001-5df9-4de2-9761-2c319f322e55 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:02.579037 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-627f9001-5df9-4de2-9761-2c319f322e55 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:02.579535 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-627f9001-5df9-4de2-9761-2c319f322e55 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:02.580008 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-627f9001-5df9-4de2-9761-2c319f322e55 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:02.580721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-627f9001-5df9-4de2-9761-2c319f322e55 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:02.581181 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-627f9001-5df9-4de2-9761-2c319f322e55 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:02.581612 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-627f9001-5df9-4de2-9761-2c319f322e55 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:02.627010 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0d9c4def-f2a7-476b-888f-110a69e0a5a3 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:02.634715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0d9c4def-f2a7-476b-888f-110a69e0a5a3 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.158309 Oct 06 11:10:02.635590 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 343/675] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:02 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:02.715186 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-627f9001-5df9-4de2-9761-2c319f322e55 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:02.723425 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-627f9001-5df9-4de2-9761-2c319f322e55 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1729 microversion: 2.1 time: 0.155642 Oct 06 11:10:02.724026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 333/676] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:02 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:10:02.746815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f92341d3-d795-42f9-8f9f-4e50e5ab7cfc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:02.747333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f92341d3-d795-42f9-8f9f-4e50e5ab7cfc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:02.753246 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92341d3-d795-42f9-8f9f-4e50e5ab7cfc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:02.753728 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92341d3-d795-42f9-8f9f-4e50e5ab7cfc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:02.754159 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92341d3-d795-42f9-8f9f-4e50e5ab7cfc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:02.754849 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92341d3-d795-42f9-8f9f-4e50e5ab7cfc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:02.755300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92341d3-d795-42f9-8f9f-4e50e5ab7cfc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:02.755721 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92341d3-d795-42f9-8f9f-4e50e5ab7cfc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:02.831825 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f92341d3-d795-42f9-8f9f-4e50e5ab7cfc tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089324 Oct 06 11:10:02.832443 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 344/677] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Oct 6 11:10:02 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:10:03.176287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8fc34532-5203-4ff6-9ed2-6b2e99567982 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:03.176816 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8fc34532-5203-4ff6-9ed2-6b2e99567982 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:03.183177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc34532-5203-4ff6-9ed2-6b2e99567982 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:03.183656 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc34532-5203-4ff6-9ed2-6b2e99567982 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:03.184120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc34532-5203-4ff6-9ed2-6b2e99567982 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:03.184806 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc34532-5203-4ff6-9ed2-6b2e99567982 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:03.185253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc34532-5203-4ff6-9ed2-6b2e99567982 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:03.185675 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc34532-5203-4ff6-9ed2-6b2e99567982 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:03.316478 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8fc34532-5203-4ff6-9ed2-6b2e99567982 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:03.324754 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8fc34532-5203-4ff6-9ed2-6b2e99567982 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.152430 Oct 06 11:10:03.325524 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 334/678] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:03 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:03.658291 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7980c94c-90b9-4036-8f58-71bbe84eaf94 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:03.659219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7980c94c-90b9-4036-8f58-71bbe84eaf94 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:03.665657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7980c94c-90b9-4036-8f58-71bbe84eaf94 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:03.666160 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7980c94c-90b9-4036-8f58-71bbe84eaf94 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:03.666605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7980c94c-90b9-4036-8f58-71bbe84eaf94 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:03.667546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7980c94c-90b9-4036-8f58-71bbe84eaf94 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:03.668042 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7980c94c-90b9-4036-8f58-71bbe84eaf94 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:03.668477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7980c94c-90b9-4036-8f58-71bbe84eaf94 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:04.006516 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7980c94c-90b9-4036-8f58-71bbe84eaf94 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:04.014287 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7980c94c-90b9-4036-8f58-71bbe84eaf94 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1319 microversion: 2.1 time: 0.360374 Oct 06 11:10:04.014863 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 345/679] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:03 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:04.154033 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b9b7bdf0-64ca-46d5-b7f0-f0ee9cbbe8a0 req-34afab49-adf8-4caa-991f-fa570bb02957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a", "tag": "ce07790b-c95e-4fab-b759-f35f2b34ca5f"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:10:04.164183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b9b7bdf0-64ca-46d5-b7f0-f0ee9cbbe8a0 req-34afab49-adf8-4caa-991f-fa570bb02957 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:04.164655 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b9b7bdf0-64ca-46d5-b7f0-f0ee9cbbe8a0 req-34afab49-adf8-4caa-991f-fa570bb02957 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:04.165100 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b9b7bdf0-64ca-46d5-b7f0-f0ee9cbbe8a0 req-34afab49-adf8-4caa-991f-fa570bb02957 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:04.176982 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b9b7bdf0-64ca-46d5-b7f0-f0ee9cbbe8a0 req-34afab49-adf8-4caa-991f-fa570bb02957 service nova] Creating event network-changed:ce07790b-c95e-4fab-b759-f35f2b34ca5f for instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a on hv-cinder-86020 Oct 06 11:10:04.182661 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b9b7bdf0-64ca-46d5-b7f0-f0ee9cbbe8a0 req-34afab49-adf8-4caa-991f-fa570bb02957 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033135 Oct 06 11:10:04.183265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 335/680] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:10:04.350715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f56dfed-3a4c-47bd-8029-fb66b4845b85 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:04.351576 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4f56dfed-3a4c-47bd-8029-fb66b4845b85 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:04.358761 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f56dfed-3a4c-47bd-8029-fb66b4845b85 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:04.359404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f56dfed-3a4c-47bd-8029-fb66b4845b85 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:04.359990 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f56dfed-3a4c-47bd-8029-fb66b4845b85 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:04.360789 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f56dfed-3a4c-47bd-8029-fb66b4845b85 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:04.361400 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f56dfed-3a4c-47bd-8029-fb66b4845b85 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:04.361928 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f56dfed-3a4c-47bd-8029-fb66b4845b85 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:04.568253 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4f56dfed-3a4c-47bd-8029-fb66b4845b85 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:04.576623 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f56dfed-3a4c-47bd-8029-fb66b4845b85 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.229851 Oct 06 11:10:04.577206 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 346/681] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:04 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:05.037778 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-266b1929-2d2e-45b5-9032-f2fa95a28d09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:05.038502 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-266b1929-2d2e-45b5-9032-f2fa95a28d09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:05.045034 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266b1929-2d2e-45b5-9032-f2fa95a28d09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:05.045521 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266b1929-2d2e-45b5-9032-f2fa95a28d09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:05.045966 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266b1929-2d2e-45b5-9032-f2fa95a28d09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:05.046695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266b1929-2d2e-45b5-9032-f2fa95a28d09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:05.047155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266b1929-2d2e-45b5-9032-f2fa95a28d09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:05.047584 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266b1929-2d2e-45b5-9032-f2fa95a28d09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:05.181511 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-266b1929-2d2e-45b5-9032-f2fa95a28d09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:05.190113 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-266b1929-2d2e-45b5-9032-f2fa95a28d09 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1508 microversion: 2.1 time: 0.156578 Oct 06 11:10:05.190610 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 336/682] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:05 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:05.212850 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c37da614-563a-489b-b8e7-a7a11832d909 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d337dc8-a6b9-4f8f-900c-d8d8f8d55372", "device": "/dev/sdb"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:10:05.215935 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c37da614-563a-489b-b8e7-a7a11832d909 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:05.222393 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37da614-563a-489b-b8e7-a7a11832d909 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:05.222912 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37da614-563a-489b-b8e7-a7a11832d909 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:05.223354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37da614-563a-489b-b8e7-a7a11832d909 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:05.224090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37da614-563a-489b-b8e7-a7a11832d909 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:05.224611 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37da614-563a-489b-b8e7-a7a11832d909 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:05.225039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37da614-563a-489b-b8e7-a7a11832d909 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:05.380006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:05.505334 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c37da614-563a-489b-b8e7-a7a11832d909 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "POST /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296265 Oct 06 11:10:05.505954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 347/683] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:10:05 2022] POST /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:10:05.601835 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e2c9f82-9fdc-46b0-aff3-9bdeb185790a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:05.602453 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e2c9f82-9fdc-46b0-aff3-9bdeb185790a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:05.609464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e2c9f82-9fdc-46b0-aff3-9bdeb185790a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:05.609952 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e2c9f82-9fdc-46b0-aff3-9bdeb185790a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:05.610393 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e2c9f82-9fdc-46b0-aff3-9bdeb185790a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:05.611095 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e2c9f82-9fdc-46b0-aff3-9bdeb185790a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:05.611561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e2c9f82-9fdc-46b0-aff3-9bdeb185790a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:05.612057 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e2c9f82-9fdc-46b0-aff3-9bdeb185790a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:05.615168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:05.748625 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e2c9f82-9fdc-46b0-aff3-9bdeb185790a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:05.758496 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e2c9f82-9fdc-46b0-aff3-9bdeb185790a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.161256 Oct 06 11:10:05.759296 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 337/684] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:05 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:06.197871 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f72bd50f-9130-40d2-b635-50f3add9bd3d req-87aa116d-fe2b-4d4d-ba2a-c443905a4116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a", "tag": "ce07790b-c95e-4fab-b759-f35f2b34ca5f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:10:06.207137 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f72bd50f-9130-40d2-b635-50f3add9bd3d req-87aa116d-fe2b-4d4d-ba2a-c443905a4116 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:06.207615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f72bd50f-9130-40d2-b635-50f3add9bd3d req-87aa116d-fe2b-4d4d-ba2a-c443905a4116 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:06.208066 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f72bd50f-9130-40d2-b635-50f3add9bd3d req-87aa116d-fe2b-4d4d-ba2a-c443905a4116 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:06.219163 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f72bd50f-9130-40d2-b635-50f3add9bd3d req-87aa116d-fe2b-4d4d-ba2a-c443905a4116 service nova] Creating event network-changed:ce07790b-c95e-4fab-b759-f35f2b34ca5f for instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a on hv-cinder-86020 Oct 06 11:10:06.224448 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f72bd50f-9130-40d2-b635-50f3add9bd3d req-87aa116d-fe2b-4d4d-ba2a-c443905a4116 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031058 Oct 06 11:10:06.225014 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 348/685] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:10:06.781825 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-889dd7c8-7a03-4f2d-910a-dabc6aedfb38 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:06.782345 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-889dd7c8-7a03-4f2d-910a-dabc6aedfb38 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:06.788812 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889dd7c8-7a03-4f2d-910a-dabc6aedfb38 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:06.789305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889dd7c8-7a03-4f2d-910a-dabc6aedfb38 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:06.789744 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889dd7c8-7a03-4f2d-910a-dabc6aedfb38 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:06.790940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889dd7c8-7a03-4f2d-910a-dabc6aedfb38 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:06.791079 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889dd7c8-7a03-4f2d-910a-dabc6aedfb38 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:06.791436 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889dd7c8-7a03-4f2d-910a-dabc6aedfb38 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:06.920554 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-889dd7c8-7a03-4f2d-910a-dabc6aedfb38 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:06.928077 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-889dd7c8-7a03-4f2d-910a-dabc6aedfb38 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.150096 Oct 06 11:10:06.928647 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 338/686] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:06 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:07.952857 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68ada6ed-f086-44f5-bae5-c63b9122b7a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:07.953485 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-68ada6ed-f086-44f5-bae5-c63b9122b7a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:07.960135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ada6ed-f086-44f5-bae5-c63b9122b7a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:07.960623 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ada6ed-f086-44f5-bae5-c63b9122b7a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:07.961062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ada6ed-f086-44f5-bae5-c63b9122b7a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:07.961760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ada6ed-f086-44f5-bae5-c63b9122b7a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:07.963307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ada6ed-f086-44f5-bae5-c63b9122b7a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:07.963743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ada6ed-f086-44f5-bae5-c63b9122b7a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:08.091248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-68ada6ed-f086-44f5-bae5-c63b9122b7a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:08.099126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68ada6ed-f086-44f5-bae5-c63b9122b7a4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.150559 Oct 06 11:10:08.099700 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 349/687] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:07 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:09.122512 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bda557f0-c326-441e-9395-e66eba05b22c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:09.123166 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bda557f0-c326-441e-9395-e66eba05b22c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:09.129586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bda557f0-c326-441e-9395-e66eba05b22c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:09.130076 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bda557f0-c326-441e-9395-e66eba05b22c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:09.130513 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bda557f0-c326-441e-9395-e66eba05b22c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:09.131205 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bda557f0-c326-441e-9395-e66eba05b22c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:09.131669 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bda557f0-c326-441e-9395-e66eba05b22c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:09.132115 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bda557f0-c326-441e-9395-e66eba05b22c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:09.263426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bda557f0-c326-441e-9395-e66eba05b22c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:09.271066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bda557f0-c326-441e-9395-e66eba05b22c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.152502 Oct 06 11:10:09.271626 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 339/688] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:09 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:10.295600 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb49e7d7-74c6-4988-b2e5-6e629373aa27 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:10.296216 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb49e7d7-74c6-4988-b2e5-6e629373aa27 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:10.302734 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb49e7d7-74c6-4988-b2e5-6e629373aa27 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:10.303216 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb49e7d7-74c6-4988-b2e5-6e629373aa27 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:10.303659 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb49e7d7-74c6-4988-b2e5-6e629373aa27 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:10.304386 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb49e7d7-74c6-4988-b2e5-6e629373aa27 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:10.304838 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb49e7d7-74c6-4988-b2e5-6e629373aa27 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:10.305262 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb49e7d7-74c6-4988-b2e5-6e629373aa27 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:10.434075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bb49e7d7-74c6-4988-b2e5-6e629373aa27 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:10.441540 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb49e7d7-74c6-4988-b2e5-6e629373aa27 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.149746 Oct 06 11:10:10.442096 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 350/689] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:10 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:10:11.465162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c51f3a08-d4b6-4a21-b8fb-3af8e5bd3a3e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:11.465710 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c51f3a08-d4b6-4a21-b8fb-3af8e5bd3a3e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:11.472338 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3a08-d4b6-4a21-b8fb-3af8e5bd3a3e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:11.472821 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3a08-d4b6-4a21-b8fb-3af8e5bd3a3e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:11.473258 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3a08-d4b6-4a21-b8fb-3af8e5bd3a3e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:11.473950 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3a08-d4b6-4a21-b8fb-3af8e5bd3a3e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:11.474400 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3a08-d4b6-4a21-b8fb-3af8e5bd3a3e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:11.474856 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3a08-d4b6-4a21-b8fb-3af8e5bd3a3e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:11.611317 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c51f3a08-d4b6-4a21-b8fb-3af8e5bd3a3e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:11.619053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c51f3a08-d4b6-4a21-b8fb-3af8e5bd3a3e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.158237 Oct 06 11:10:11.619614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 340/690] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:11 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:12.643328 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ae20d820-7f4b-43a7-a20a-9246d9f55971 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:12.643889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ae20d820-7f4b-43a7-a20a-9246d9f55971 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:12.651223 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae20d820-7f4b-43a7-a20a-9246d9f55971 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:12.651705 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae20d820-7f4b-43a7-a20a-9246d9f55971 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:12.652177 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae20d820-7f4b-43a7-a20a-9246d9f55971 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:12.652874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae20d820-7f4b-43a7-a20a-9246d9f55971 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:12.653331 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae20d820-7f4b-43a7-a20a-9246d9f55971 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:12.653763 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae20d820-7f4b-43a7-a20a-9246d9f55971 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:12.785113 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae20d820-7f4b-43a7-a20a-9246d9f55971 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:12.793918 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ae20d820-7f4b-43a7-a20a-9246d9f55971 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.154539 Oct 06 11:10:12.794482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 351/691] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:12 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:13.817515 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c967e319-8c87-4fff-b1e3-5c56c6c6e285 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:13.818123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c967e319-8c87-4fff-b1e3-5c56c6c6e285 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:13.824650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c967e319-8c87-4fff-b1e3-5c56c6c6e285 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:13.825136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c967e319-8c87-4fff-b1e3-5c56c6c6e285 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:13.825573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c967e319-8c87-4fff-b1e3-5c56c6c6e285 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:13.826264 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c967e319-8c87-4fff-b1e3-5c56c6c6e285 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:13.826721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c967e319-8c87-4fff-b1e3-5c56c6c6e285 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:13.827145 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c967e319-8c87-4fff-b1e3-5c56c6c6e285 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:13.957331 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c967e319-8c87-4fff-b1e3-5c56c6c6e285 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:13.965653 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c967e319-8c87-4fff-b1e3-5c56c6c6e285 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.151950 Oct 06 11:10:13.966215 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 341/692] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:13 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:14.989279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-174ca1f0-6f5c-478a-8f81-cbaf22da0cf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:14.989898 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-174ca1f0-6f5c-478a-8f81-cbaf22da0cf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:14.997278 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-174ca1f0-6f5c-478a-8f81-cbaf22da0cf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:14.997767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-174ca1f0-6f5c-478a-8f81-cbaf22da0cf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:14.998206 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-174ca1f0-6f5c-478a-8f81-cbaf22da0cf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:14.998902 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-174ca1f0-6f5c-478a-8f81-cbaf22da0cf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:14.999356 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-174ca1f0-6f5c-478a-8f81-cbaf22da0cf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:14.999781 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-174ca1f0-6f5c-478a-8f81-cbaf22da0cf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:15.128592 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-174ca1f0-6f5c-478a-8f81-cbaf22da0cf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:15.136902 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-174ca1f0-6f5c-478a-8f81-cbaf22da0cf5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.151446 Oct 06 11:10:15.137463 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 352/693] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:14 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:16.159471 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-705250d2-75c4-4281-af9f-209529ccaf72 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:16.160120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-705250d2-75c4-4281-af9f-209529ccaf72 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:16.167327 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705250d2-75c4-4281-af9f-209529ccaf72 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:16.167819 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705250d2-75c4-4281-af9f-209529ccaf72 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:16.168290 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705250d2-75c4-4281-af9f-209529ccaf72 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:16.168994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705250d2-75c4-4281-af9f-209529ccaf72 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:16.169487 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705250d2-75c4-4281-af9f-209529ccaf72 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:16.169914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705250d2-75c4-4281-af9f-209529ccaf72 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:16.297006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-705250d2-75c4-4281-af9f-209529ccaf72 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:16.304661 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-705250d2-75c4-4281-af9f-209529ccaf72 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.149084 Oct 06 11:10:16.305228 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 342/694] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:16 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:17.329081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bda3b9c8-4dd5-47d7-bc05-b7554124f892 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:17.329631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bda3b9c8-4dd5-47d7-bc05-b7554124f892 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:17.332050 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:17.337221 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda3b9c8-4dd5-47d7-bc05-b7554124f892 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:17.337708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda3b9c8-4dd5-47d7-bc05-b7554124f892 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:17.338183 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda3b9c8-4dd5-47d7-bc05-b7554124f892 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:17.338889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda3b9c8-4dd5-47d7-bc05-b7554124f892 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:17.339345 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda3b9c8-4dd5-47d7-bc05-b7554124f892 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:17.339773 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bda3b9c8-4dd5-47d7-bc05-b7554124f892 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:17.472548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bda3b9c8-4dd5-47d7-bc05-b7554124f892 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:17.480736 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bda3b9c8-4dd5-47d7-bc05-b7554124f892 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.155579 Oct 06 11:10:17.481302 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 353/695] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:17 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:18.504406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-144f20d1-702d-466c-86ab-689ebf88f402 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:18.505021 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-144f20d1-702d-466c-86ab-689ebf88f402 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:18.511288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144f20d1-702d-466c-86ab-689ebf88f402 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:18.511778 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144f20d1-702d-466c-86ab-689ebf88f402 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:18.512312 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144f20d1-702d-466c-86ab-689ebf88f402 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:18.513003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144f20d1-702d-466c-86ab-689ebf88f402 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:18.513455 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144f20d1-702d-466c-86ab-689ebf88f402 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:18.513876 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144f20d1-702d-466c-86ab-689ebf88f402 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:18.640591 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-144f20d1-702d-466c-86ab-689ebf88f402 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:18.648364 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-144f20d1-702d-466c-86ab-689ebf88f402 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.147952 Oct 06 11:10:18.648923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 343/696] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:18 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:19.672806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88274e91-67e0-4bfd-98db-91bdc5a2cafc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:19.673345 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-88274e91-67e0-4bfd-98db-91bdc5a2cafc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:19.679627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88274e91-67e0-4bfd-98db-91bdc5a2cafc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:19.680160 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88274e91-67e0-4bfd-98db-91bdc5a2cafc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:19.680605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88274e91-67e0-4bfd-98db-91bdc5a2cafc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:19.681319 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88274e91-67e0-4bfd-98db-91bdc5a2cafc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:19.682352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88274e91-67e0-4bfd-98db-91bdc5a2cafc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:19.682975 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88274e91-67e0-4bfd-98db-91bdc5a2cafc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:19.812797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-88274e91-67e0-4bfd-98db-91bdc5a2cafc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:19.820394 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88274e91-67e0-4bfd-98db-91bdc5a2cafc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.151507 Oct 06 11:10:19.820957 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 354/697] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:19 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:20.844993 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1a3be0b-cbfb-4f4c-a267-346c7f02e02d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:20.845599 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1a3be0b-cbfb-4f4c-a267-346c7f02e02d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:20.852012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1a3be0b-cbfb-4f4c-a267-346c7f02e02d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:20.852493 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1a3be0b-cbfb-4f4c-a267-346c7f02e02d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:20.852925 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1a3be0b-cbfb-4f4c-a267-346c7f02e02d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:20.853607 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1a3be0b-cbfb-4f4c-a267-346c7f02e02d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:20.854064 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1a3be0b-cbfb-4f4c-a267-346c7f02e02d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:20.854474 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1a3be0b-cbfb-4f4c-a267-346c7f02e02d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:20.985741 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1a3be0b-cbfb-4f4c-a267-346c7f02e02d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:20.993292 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1a3be0b-cbfb-4f4c-a267-346c7f02e02d tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.152190 Oct 06 11:10:20.993857 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 344/698] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:20 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:22.016902 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c053dc1e-8aa7-4728-92d8-ac9d83f51111 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:22.017516 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c053dc1e-8aa7-4728-92d8-ac9d83f51111 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:22.024186 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c053dc1e-8aa7-4728-92d8-ac9d83f51111 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:22.024679 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c053dc1e-8aa7-4728-92d8-ac9d83f51111 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:22.025119 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c053dc1e-8aa7-4728-92d8-ac9d83f51111 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:22.026389 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c053dc1e-8aa7-4728-92d8-ac9d83f51111 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:22.026847 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c053dc1e-8aa7-4728-92d8-ac9d83f51111 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:22.027275 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c053dc1e-8aa7-4728-92d8-ac9d83f51111 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:22.154745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c053dc1e-8aa7-4728-92d8-ac9d83f51111 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:22.162463 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c053dc1e-8aa7-4728-92d8-ac9d83f51111 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.149442 Oct 06 11:10:22.163034 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 355/699] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:22 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:23.185738 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-48ad54b8-62fb-4d7f-8744-199309add05c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:23.186394 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-48ad54b8-62fb-4d7f-8744-199309add05c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:23.193124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48ad54b8-62fb-4d7f-8744-199309add05c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:23.193614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48ad54b8-62fb-4d7f-8744-199309add05c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:23.194058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48ad54b8-62fb-4d7f-8744-199309add05c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:23.194752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48ad54b8-62fb-4d7f-8744-199309add05c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:23.195242 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48ad54b8-62fb-4d7f-8744-199309add05c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:23.195672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48ad54b8-62fb-4d7f-8744-199309add05c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:23.330595 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-48ad54b8-62fb-4d7f-8744-199309add05c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:23.339069 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-48ad54b8-62fb-4d7f-8744-199309add05c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.156951 Oct 06 11:10:23.339690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 345/700] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:23 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:24.365274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abb6422c-bc8d-450e-99b6-195ab28161fc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:24.365891 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abb6422c-bc8d-450e-99b6-195ab28161fc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:24.375321 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb6422c-bc8d-450e-99b6-195ab28161fc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:24.375807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb6422c-bc8d-450e-99b6-195ab28161fc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:24.376272 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb6422c-bc8d-450e-99b6-195ab28161fc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:24.376971 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb6422c-bc8d-450e-99b6-195ab28161fc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:24.377425 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb6422c-bc8d-450e-99b6-195ab28161fc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:24.377847 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb6422c-bc8d-450e-99b6-195ab28161fc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:24.528305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-abb6422c-bc8d-450e-99b6-195ab28161fc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:24.536093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abb6422c-bc8d-450e-99b6-195ab28161fc tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.176356 Oct 06 11:10:24.536669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 356/701] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:24 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:25.565030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f760ec1b-408e-4abc-ac82-82746813ab36 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:25.565645 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f760ec1b-408e-4abc-ac82-82746813ab36 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:25.569035 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=46 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:25.573476 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f760ec1b-408e-4abc-ac82-82746813ab36 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:25.573951 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f760ec1b-408e-4abc-ac82-82746813ab36 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:25.574384 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f760ec1b-408e-4abc-ac82-82746813ab36 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:25.575122 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f760ec1b-408e-4abc-ac82-82746813ab36 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:25.575762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f760ec1b-408e-4abc-ac82-82746813ab36 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:25.576438 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f760ec1b-408e-4abc-ac82-82746813ab36 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:25.717541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f760ec1b-408e-4abc-ac82-82746813ab36 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:25.725748 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f760ec1b-408e-4abc-ac82-82746813ab36 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.166526 Oct 06 11:10:25.726311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 346/702] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:25 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:26.750895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3df43855-d0b7-4f90-9c40-d5512aa7431e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:26.751539 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3df43855-d0b7-4f90-9c40-d5512aa7431e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:26.757976 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df43855-d0b7-4f90-9c40-d5512aa7431e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:26.758466 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df43855-d0b7-4f90-9c40-d5512aa7431e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:26.758939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df43855-d0b7-4f90-9c40-d5512aa7431e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:26.759645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df43855-d0b7-4f90-9c40-d5512aa7431e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:26.760141 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df43855-d0b7-4f90-9c40-d5512aa7431e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:26.760567 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df43855-d0b7-4f90-9c40-d5512aa7431e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:26.891402 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3df43855-d0b7-4f90-9c40-d5512aa7431e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:26.900052 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3df43855-d0b7-4f90-9c40-d5512aa7431e tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.152958 Oct 06 11:10:26.901164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 357/703] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:26 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:27.924059 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-291c0198-7b07-4561-9215-36d2371cf6ac tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:27.924674 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-291c0198-7b07-4561-9215-36d2371cf6ac tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:27.930940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291c0198-7b07-4561-9215-36d2371cf6ac tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:27.931422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291c0198-7b07-4561-9215-36d2371cf6ac tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:27.932089 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291c0198-7b07-4561-9215-36d2371cf6ac tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:27.933074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291c0198-7b07-4561-9215-36d2371cf6ac tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:27.933522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291c0198-7b07-4561-9215-36d2371cf6ac tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:27.933945 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291c0198-7b07-4561-9215-36d2371cf6ac tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:28.070741 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-291c0198-7b07-4561-9215-36d2371cf6ac tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:28.078404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-291c0198-7b07-4561-9215-36d2371cf6ac tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1675 microversion: 2.1 time: 0.158138 Oct 06 11:10:28.078976 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 347/704] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:27 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:29.048814 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e5cdbc0-9131-4a87-84ae-e8d92f3c8b7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:29.049296 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e5cdbc0-9131-4a87-84ae-e8d92f3c8b7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:29.055496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5cdbc0-9131-4a87-84ae-e8d92f3c8b7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:29.056027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5cdbc0-9131-4a87-84ae-e8d92f3c8b7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:29.056465 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5cdbc0-9131-4a87-84ae-e8d92f3c8b7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:29.057157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5cdbc0-9131-4a87-84ae-e8d92f3c8b7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:29.057611 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5cdbc0-9131-4a87-84ae-e8d92f3c8b7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:29.058042 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e5cdbc0-9131-4a87-84ae-e8d92f3c8b7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:29.101779 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aca8406a-5f24-4582-8bb0-395bea4025e8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:29.102403 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aca8406a-5f24-4582-8bb0-395bea4025e8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:29.109025 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aca8406a-5f24-4582-8bb0-395bea4025e8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:29.109813 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aca8406a-5f24-4582-8bb0-395bea4025e8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:29.110154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aca8406a-5f24-4582-8bb0-395bea4025e8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:29.110932 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aca8406a-5f24-4582-8bb0-395bea4025e8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:29.111424 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aca8406a-5f24-4582-8bb0-395bea4025e8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:29.111869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aca8406a-5f24-4582-8bb0-395bea4025e8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:29.142270 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-5e5cdbc0-9131-4a87-84ae-e8d92f3c8b7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lazy-loading 'services' on Instance uuid b5e6d241-c477-4909-b878-c122be3ee91e {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:10:29.225470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e5cdbc0-9131-4a87-84ae-e8d92f3c8b7c tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e/os-volume_attachments/2d337dc8-a6b9-4f8f-900c-d8d8f8d55372" status: 202 len: 0 microversion: 2.1 time: 0.180317 Oct 06 11:10:29.226167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 358/705] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:10:29 2022] DELETE /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e/os-volume_attachments/2d337dc8-a6b9-4f8f-900c-d8d8f8d55372 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:10:29.242980 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-aca8406a-5f24-4582-8bb0-395bea4025e8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:29.252485 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aca8406a-5f24-4582-8bb0-395bea4025e8 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1652 microversion: 2.1 time: 0.154516 Oct 06 11:10:29.253080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 348/706] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:29 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1652 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:29.276178 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e575876-6f78-4345-8023-036efc72df22 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:10:29.288609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e575876-6f78-4345-8023-036efc72df22 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:29.289175 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e575876-6f78-4345-8023-036efc72df22 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:29.289703 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e575876-6f78-4345-8023-036efc72df22 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:29.312427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e575876-6f78-4345-8023-036efc72df22 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Going to try to start instance {{(pid=120603) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 11:10:29.355610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e575876-6f78-4345-8023-036efc72df22 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/action" status: 202 len: 0 microversion: 2.1 time: 0.082782 Oct 06 11:10:29.356538 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 359/707] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:10:29 2022] POST /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 11:10:29.365010 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d8a5df4e-c42a-498b-ae72-1066e32f5644 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:29.365744 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d8a5df4e-c42a-498b-ae72-1066e32f5644 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:29.372251 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8a5df4e-c42a-498b-ae72-1066e32f5644 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:29.372836 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8a5df4e-c42a-498b-ae72-1066e32f5644 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:29.373343 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8a5df4e-c42a-498b-ae72-1066e32f5644 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:29.374116 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8a5df4e-c42a-498b-ae72-1066e32f5644 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:29.374762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8a5df4e-c42a-498b-ae72-1066e32f5644 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:29.375197 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8a5df4e-c42a-498b-ae72-1066e32f5644 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:29.507743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d8a5df4e-c42a-498b-ae72-1066e32f5644 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:29.515876 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d8a5df4e-c42a-498b-ae72-1066e32f5644 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1661 microversion: 2.1 time: 0.155126 Oct 06 11:10:29.516447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 349/708] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:29 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:10:30.357772 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1dc04594-1298-484a-9aed-8bd668849a71 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:30.358368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1dc04594-1298-484a-9aed-8bd668849a71 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:30.365003 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc04594-1298-484a-9aed-8bd668849a71 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:30.365488 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc04594-1298-484a-9aed-8bd668849a71 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:30.366136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc04594-1298-484a-9aed-8bd668849a71 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:30.366864 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc04594-1298-484a-9aed-8bd668849a71 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:30.367309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc04594-1298-484a-9aed-8bd668849a71 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:30.367751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc04594-1298-484a-9aed-8bd668849a71 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:30.399134 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1dc04594-1298-484a-9aed-8bd668849a71 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:10:30.451134 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:30.480892 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1dc04594-1298-484a-9aed-8bd668849a71 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 204 len: 0 microversion: 2.1 time: 0.126965 Oct 06 11:10:30.484542 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 360/709] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:10:30 2022] DELETE /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:10:30.489623 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0ec8296-86b7-40e2-94e3-27e9d001253a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:30.490789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0ec8296-86b7-40e2-94e3-27e9d001253a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:30.498102 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0ec8296-86b7-40e2-94e3-27e9d001253a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:30.498571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0ec8296-86b7-40e2-94e3-27e9d001253a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:30.499007 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0ec8296-86b7-40e2-94e3-27e9d001253a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:30.499920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0ec8296-86b7-40e2-94e3-27e9d001253a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:30.500379 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0ec8296-86b7-40e2-94e3-27e9d001253a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:30.500805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0ec8296-86b7-40e2-94e3-27e9d001253a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:30.540605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59a9ad2f-95cc-4ca5-abe7-430f3b750af4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:30.541310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59a9ad2f-95cc-4ca5-abe7-430f3b750af4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:30.548362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a9ad2f-95cc-4ca5-abe7-430f3b750af4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:30.548879 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a9ad2f-95cc-4ca5-abe7-430f3b750af4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:30.549300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a9ad2f-95cc-4ca5-abe7-430f3b750af4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:30.550040 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a9ad2f-95cc-4ca5-abe7-430f3b750af4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:30.550497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a9ad2f-95cc-4ca5-abe7-430f3b750af4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:30.550922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a9ad2f-95cc-4ca5-abe7-430f3b750af4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:30.632552 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f0ec8296-86b7-40e2-94e3-27e9d001253a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:30.641380 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0ec8296-86b7-40e2-94e3-27e9d001253a tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1514 microversion: 2.1 time: 0.155533 Oct 06 11:10:30.641956 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 350/710] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:30 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:30.686800 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-59a9ad2f-95cc-4ca5-abe7-430f3b750af4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:30.694556 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59a9ad2f-95cc-4ca5-abe7-430f3b750af4 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1661 microversion: 2.1 time: 0.158099 Oct 06 11:10:30.695132 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 361/711] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:30 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:10:31.665265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-48f4b2c8-42d2-40eb-b91b-7c7600e80265 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:31.665803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-48f4b2c8-42d2-40eb-b91b-7c7600e80265 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:31.672249 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48f4b2c8-42d2-40eb-b91b-7c7600e80265 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:31.672724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48f4b2c8-42d2-40eb-b91b-7c7600e80265 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:31.673155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48f4b2c8-42d2-40eb-b91b-7c7600e80265 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:31.673839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48f4b2c8-42d2-40eb-b91b-7c7600e80265 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:31.674287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48f4b2c8-42d2-40eb-b91b-7c7600e80265 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:31.674706 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48f4b2c8-42d2-40eb-b91b-7c7600e80265 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:31.717761 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c388f36-fc7f-4a98-9795-3c1349bc82cb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:31.718415 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c388f36-fc7f-4a98-9795-3c1349bc82cb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:31.724752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c388f36-fc7f-4a98-9795-3c1349bc82cb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:31.725240 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c388f36-fc7f-4a98-9795-3c1349bc82cb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:31.725678 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c388f36-fc7f-4a98-9795-3c1349bc82cb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:31.726378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c388f36-fc7f-4a98-9795-3c1349bc82cb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:31.726836 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c388f36-fc7f-4a98-9795-3c1349bc82cb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:31.727279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c388f36-fc7f-4a98-9795-3c1349bc82cb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:31.809262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-48f4b2c8-42d2-40eb-b91b-7c7600e80265 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:31.817237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-48f4b2c8-42d2-40eb-b91b-7c7600e80265 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1514 microversion: 2.1 time: 0.155922 Oct 06 11:10:31.817910 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 351/712] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:31 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:31.858214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c388f36-fc7f-4a98-9795-3c1349bc82cb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:31.865759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c388f36-fc7f-4a98-9795-3c1349bc82cb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1661 microversion: 2.1 time: 0.152398 Oct 06 11:10:31.866317 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 362/713] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:31 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:10:32.841518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23ec3dfa-ac03-4ea9-baf0-7aa1ed9f1025 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:32.842131 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-23ec3dfa-ac03-4ea9-baf0-7aa1ed9f1025 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:32.848563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ec3dfa-ac03-4ea9-baf0-7aa1ed9f1025 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:32.849044 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ec3dfa-ac03-4ea9-baf0-7aa1ed9f1025 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:32.849484 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ec3dfa-ac03-4ea9-baf0-7aa1ed9f1025 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:32.850181 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ec3dfa-ac03-4ea9-baf0-7aa1ed9f1025 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:32.850642 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ec3dfa-ac03-4ea9-baf0-7aa1ed9f1025 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:32.851068 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ec3dfa-ac03-4ea9-baf0-7aa1ed9f1025 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:32.889903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b97e928-dbf8-4db6-b535-f408c4a4e7d5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:32.890521 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b97e928-dbf8-4db6-b535-f408c4a4e7d5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:32.897491 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b97e928-dbf8-4db6-b535-f408c4a4e7d5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:32.897986 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b97e928-dbf8-4db6-b535-f408c4a4e7d5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:32.898427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b97e928-dbf8-4db6-b535-f408c4a4e7d5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:32.899131 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b97e928-dbf8-4db6-b535-f408c4a4e7d5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:32.899589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b97e928-dbf8-4db6-b535-f408c4a4e7d5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:32.900051 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b97e928-dbf8-4db6-b535-f408c4a4e7d5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:32.981636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-23ec3dfa-ac03-4ea9-baf0-7aa1ed9f1025 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:32.989586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23ec3dfa-ac03-4ea9-baf0-7aa1ed9f1025 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1514 microversion: 2.1 time: 0.152454 Oct 06 11:10:32.990159 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 352/714] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:32 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:10:33.031434 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b97e928-dbf8-4db6-b535-f408c4a4e7d5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:33.038928 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b97e928-dbf8-4db6-b535-f408c4a4e7d5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1665 microversion: 2.1 time: 0.152967 Oct 06 11:10:33.039486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 363/715] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:32 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:10:34.012688 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba303295-3e77-4cd7-9111-61e24f44ac04 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:34.013358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba303295-3e77-4cd7-9111-61e24f44ac04 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:34.020139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba303295-3e77-4cd7-9111-61e24f44ac04 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:34.020625 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba303295-3e77-4cd7-9111-61e24f44ac04 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:34.021086 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba303295-3e77-4cd7-9111-61e24f44ac04 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:34.022269 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba303295-3e77-4cd7-9111-61e24f44ac04 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:34.022722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba303295-3e77-4cd7-9111-61e24f44ac04 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:34.023144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba303295-3e77-4cd7-9111-61e24f44ac04 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:34.040373 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f7a2cf3c-72d7-4923-b7b1-e6414d090155 req-f4b7ffe5-df20-4f5e-866c-8a9eb8b83357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e6d241-c477-4909-b878-c122be3ee91e", "name": "network-vif-deleted", "tag": "8f99a7a0-4a65-4113-aaa9-dbcdf5a716b2"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:10:34.050554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f7a2cf3c-72d7-4923-b7b1-e6414d090155 req-f4b7ffe5-df20-4f5e-866c-8a9eb8b83357 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:34.051053 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f7a2cf3c-72d7-4923-b7b1-e6414d090155 req-f4b7ffe5-df20-4f5e-866c-8a9eb8b83357 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:34.051492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f7a2cf3c-72d7-4923-b7b1-e6414d090155 req-f4b7ffe5-df20-4f5e-866c-8a9eb8b83357 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:34.062799 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f7a2cf3c-72d7-4923-b7b1-e6414d090155 req-f4b7ffe5-df20-4f5e-866c-8a9eb8b83357 service nova] Creating event network-vif-deleted:8f99a7a0-4a65-4113-aaa9-dbcdf5a716b2 for instance b5e6d241-c477-4909-b878-c122be3ee91e on hv-cinder-86020 Oct 06 11:10:34.067594 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f7a2cf3c-72d7-4923-b7b1-e6414d090155 req-f4b7ffe5-df20-4f5e-866c-8a9eb8b83357 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030867 Oct 06 11:10:34.068436 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 364/716] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:10:34.094997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba303295-3e77-4cd7-9111-61e24f44ac04 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59074dbc0ef44686a396b6aaaf19ea25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f981425a83c4eb6a71891c756977764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:34.097317 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:34.103970 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba303295-3e77-4cd7-9111-61e24f44ac04 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 200 len: 1472 microversion: 2.1 time: 0.095903 Oct 06 11:10:34.104571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 353/717] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:34 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 1472 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:35.131048 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:35.131764 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] [instance: b5e6d241-c477-4909-b878-c122be3ee91e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:35.138150 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:35.138641 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:35.139083 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:35.139782 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:35.140268 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:35.140698 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:35.154743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] HTTP exception thrown: Instance b5e6d241-c477-4909-b878-c122be3ee91e could not be found. Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Request method failure captured: Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e HTTP/1.1 Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrcSdLOf2CCYKX0t2jKHGCgk0KUtS1v74S9Q3QXs6vE5DoRgZ7TRRnx1v-d3DeAZQDaMOc1cx3maoVBLQ3Z4X-gvq1-A88gOVj2glaipQIve-7bk_YRcVicMdsxdn_74OcXkyh7QRELbVAsbkTT4EREuP8NGA7klw-0ItIMXQf81RBw Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 8f981425a83c4eb6a71891c756977764 Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesSnapshotTestJSON-236485130 Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:10:35.156361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f981425a83c4eb6a71891c756977764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f981425a83c4eb6a71891c756977764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f981425a83c4eb6a71891c756977764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f981425a83c4eb6a71891c756977764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesSnapshotTestJSON-236485130 Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 8f981425a83c4eb6a71891c756977764 Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-236485130 Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesSnapshotTestJSON-236485130-project Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 59074dbc0ef44686a396b6aaaf19ea25 Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesSnapshotTestJSON-236485130-project Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance b5e6d241-c477-4909-b878-c122be3ee91e could not be found. Oct 06 11:10:35.157911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': 'b5e6d241-c477-4909-b878-c122be3ee91e'} Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e6d241-c477-4909-b878-c122be3ee91e could not be found. Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:10:35.158726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e6d241-c477-4909-b878-c122be3ee91e could not be found. Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e6d241-c477-4909-b878-c122be3ee91e could not be found. Oct 06 11:10:35.160254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:10:35.161524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] Returning 404 to user: Instance b5e6d241-c477-4909-b878-c122be3ee91e could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:10:35.161524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5976778-a167-4fcc-80a9-e114a81eb626 tempest-VolumesSnapshotTestJSON-236485130 tempest-VolumesSnapshotTestJSON-236485130-project] 10.222.0.52 "GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e" status: 404 len: 111 microversion: 2.1 time: 0.034649 Oct 06 11:10:35.161524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 365/718] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:10:35 2022] GET /compute/v2.1/servers/b5e6d241-c477-4909-b878-c122be3ee91e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:10:52.369325 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-289b4f0c-aedb-4590-b680-7c59143ef451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:52.369911 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-289b4f0c-aedb-4590-b680-7c59143ef451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:52.372130 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=15 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:52.372831 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:52.379136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289b4f0c-aedb-4590-b680-7c59143ef451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:52.379626 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289b4f0c-aedb-4590-b680-7c59143ef451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:52.380087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289b4f0c-aedb-4590-b680-7c59143ef451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:52.380775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289b4f0c-aedb-4590-b680-7c59143ef451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:52.381224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289b4f0c-aedb-4590-b680-7c59143ef451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:52.381644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289b4f0c-aedb-4590-b680-7c59143ef451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:52.413290 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-289b4f0c-aedb-4590-b680-7c59143ef451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-volume_attachments/52985e6c-73a3-452c-beb6-3e0875379dbd" status: 200 len: 194 microversion: 2.20 time: 0.047799 Oct 06 11:10:52.413863 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 354/719] 10.222.0.52 () {60 vars in 1454 bytes} [Thu Oct 6 11:10:52 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-volume_attachments/52985e6c-73a3-452c-beb6-3e0875379dbd => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 11:10:52.487416 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-285e3bcb-8c4f-431e-a21c-495ed7124da3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:52.487928 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-285e3bcb-8c4f-431e-a21c-495ed7124da3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:52.490275 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:52.490925 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=22 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:52.497149 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-285e3bcb-8c4f-431e-a21c-495ed7124da3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:52.497645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-285e3bcb-8c4f-431e-a21c-495ed7124da3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:52.498087 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-285e3bcb-8c4f-431e-a21c-495ed7124da3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:52.498818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-285e3bcb-8c4f-431e-a21c-495ed7124da3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:52.499278 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-285e3bcb-8c4f-431e-a21c-495ed7124da3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:52.499711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-285e3bcb-8c4f-431e-a21c-495ed7124da3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:52.583484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-285e3bcb-8c4f-431e-a21c-495ed7124da3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lazy-loading 'services' on Instance uuid ea9fceeb-0987-4e4f-b34b-f524fa791d3b {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:10:52.654930 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-285e3bcb-8c4f-431e-a21c-495ed7124da3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-volume_attachments/52985e6c-73a3-452c-beb6-3e0875379dbd" status: 202 len: 0 microversion: 2.20 time: 0.171190 Oct 06 11:10:52.655637 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 366/720] 10.222.0.52 () {60 vars in 1457 bytes} [Thu Oct 6 11:10:52 2022] DELETE /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-volume_attachments/52985e6c-73a3-452c-beb6-3e0875379dbd => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:10:52.664118 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ac97ded-2a57-41a8-bd53-0cbe0124f86e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:52.666329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ac97ded-2a57-41a8-bd53-0cbe0124f86e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:52.673895 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac97ded-2a57-41a8-bd53-0cbe0124f86e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:52.674503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac97ded-2a57-41a8-bd53-0cbe0124f86e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:52.674840 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac97ded-2a57-41a8-bd53-0cbe0124f86e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:52.675550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac97ded-2a57-41a8-bd53-0cbe0124f86e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:52.676050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac97ded-2a57-41a8-bd53-0cbe0124f86e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:52.676483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac97ded-2a57-41a8-bd53-0cbe0124f86e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:52.706897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ac97ded-2a57-41a8-bd53-0cbe0124f86e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046715 Oct 06 11:10:52.707460 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 355/721] 10.222.0.52 () {60 vars in 1343 bytes} [Thu Oct 6 11:10:52 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 11:10:53.720225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8bfcc65-01c5-407a-9361-c6668540bd88 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:53.722626 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8bfcc65-01c5-407a-9361-c6668540bd88 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:53.729060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8bfcc65-01c5-407a-9361-c6668540bd88 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:53.729546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8bfcc65-01c5-407a-9361-c6668540bd88 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:53.729994 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8bfcc65-01c5-407a-9361-c6668540bd88 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:53.730680 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8bfcc65-01c5-407a-9361-c6668540bd88 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:53.731137 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8bfcc65-01c5-407a-9361-c6668540bd88 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:53.731566 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8bfcc65-01c5-407a-9361-c6668540bd88 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:53.763558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b8bfcc65-01c5-407a-9361-c6668540bd88 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048399 Oct 06 11:10:53.763975 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 367/722] 10.222.0.52 () {60 vars in 1343 bytes} [Thu Oct 6 11:10:53 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:10:53.832399 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be01409d-abba-471b-adc3-3576aebac26e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:53.832931 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-be01409d-abba-471b-adc3-3576aebac26e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:53.839722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be01409d-abba-471b-adc3-3576aebac26e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:53.840238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be01409d-abba-471b-adc3-3576aebac26e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:53.840737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be01409d-abba-471b-adc3-3576aebac26e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:53.842266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be01409d-abba-471b-adc3-3576aebac26e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:53.842754 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be01409d-abba-471b-adc3-3576aebac26e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:53.843185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be01409d-abba-471b-adc3-3576aebac26e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:53.868332 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-be01409d-abba-471b-adc3-3576aebac26e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:10:53.941931 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be01409d-abba-471b-adc3-3576aebac26e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 204 len: 0 microversion: 2.20 time: 0.112616 Oct 06 11:10:53.942516 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 356/723] 10.222.0.52 () {60 vars in 1280 bytes} [Thu Oct 6 11:10:53 2022] DELETE /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 11:10:53.951336 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:53.951979 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:53.957797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:53.958285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:53.958734 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:53.959434 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:53.959922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:53.960352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:54.095809 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:54.104129 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:54.105572 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:54.106725 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a13057e-d268-4c0c-a007-c15757b6f6de tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.159939 Oct 06 11:10:54.107277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 368/724] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:10:53 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:10:55.132808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:55.133540 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:55.140635 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:55.141126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:55.141566 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:55.142271 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:55.142729 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:55.143155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:55.273424 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:55.281355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:55.282782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:55.283958 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a3160e94-1527-4aba-a124-1ffe82d8357e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.155498 Oct 06 11:10:55.284509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 357/725] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:10:55 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:10:56.310567 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:56.311406 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:56.317844 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:56.318430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:56.318883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:56.319596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:56.320083 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:56.320518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:56.587528 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:56.596395 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:56.597862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:56.599056 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5eeef2c7-1d7c-4771-8ddd-0a78e70c113d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1722 microversion: 2.20 time: 0.293050 Oct 06 11:10:56.599604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 369/726] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:10:56 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:10:57.342585 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e2f03976-6c1a-4320-90a5-143b38ade5d7 req-75222144-48d1-4e87-a134-ff7aad0cf12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9fceeb-0987-4e4f-b34b-f524fa791d3b", "name": "network-vif-deleted", "tag": "e16aada9-7c39-402c-9979-d8f302e4c39a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:10:57.358446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e2f03976-6c1a-4320-90a5-143b38ade5d7 req-75222144-48d1-4e87-a134-ff7aad0cf12c service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:57.359558 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e2f03976-6c1a-4320-90a5-143b38ade5d7 req-75222144-48d1-4e87-a134-ff7aad0cf12c service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:57.360564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e2f03976-6c1a-4320-90a5-143b38ade5d7 req-75222144-48d1-4e87-a134-ff7aad0cf12c service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:57.375536 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e2f03976-6c1a-4320-90a5-143b38ade5d7 req-75222144-48d1-4e87-a134-ff7aad0cf12c service nova] Creating event network-vif-deleted:e16aada9-7c39-402c-9979-d8f302e4c39a for instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b on hv-cinder-86020 Oct 06 11:10:57.382278 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e2f03976-6c1a-4320-90a5-143b38ade5d7 req-75222144-48d1-4e87-a134-ff7aad0cf12c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044914 Oct 06 11:10:57.383157 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 358/727] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:10:57.627873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:57.628846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:57.632370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 11:10:57.632612 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Thu Oct 6 11:10:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b (ip 10.222.0.52) !!! Oct 06 11:10:57.645421 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:57.646145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:57.646752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:57.648051 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:57.648697 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:57.649430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:57.689551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:57.690051 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:57.690494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:57.690951 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lazy-loading 'fault' on Instance uuid ea9fceeb-0987-4e4f-b34b-f524fa791d3b {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:10:57.739705 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:57.749014 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:57.750822 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:10:57.752198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0a97c9e-38c5-41ea-b1c0-a86851aa5c1d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 200 len: 1371 microversion: 2.20 time: 0.130426 Oct 06 11:10:57.753528 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 370/728] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:10:57 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:10:58.779556 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:58.780447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:10:58.787578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:58.788059 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:58.788505 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:58.789283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:10:58.789760 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:10:58.790414 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:10:58.804628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] HTTP exception thrown: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Request method failure captured: Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b HTTP/1.1 Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYttKBuvPgE7DG1oPbMv6f_tPHD4OtAPVW9Mnrl05Y1xZW27nNfKO7Ph_ZupSJjoqD5_MacX356Zb7RsTXzqjoKmpYMFbWTbW9IG0mFs0HHE7VcCMIblIw-kN6dSqaJSSRJYaH1wSK4516vovqqPGmdbnSFrbBJaW2ACi6KpCuTpqo Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:10:58.806283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b886dc365684ab1811d100eb5774619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b886dc365684ab1811d100eb5774619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 56835f0c8dc0416d9fa70662e40c856d Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:10:58.808004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': 'ea9fceeb-0987-4e4f-b34b-f524fa791d3b'} Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:10:58.808901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:10:58.810861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:10:58.812215 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Returning 404 to user: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:10:58.812215 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b1a9094-91ec-4aa4-a5d1-fca22ba547e5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 404 len: 111 microversion: 2.20 time: 0.032557 Oct 06 11:10:58.812215 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 359/729] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:10:58 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 11:10:58.817589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-954aaa5e-9071-45a1-b557-07b3421d85a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '.version_select at 0x7f92a6d87550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:10:58.841135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-954aaa5e-9071-45a1-b557-07b3421d85a7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-970010329" status: 204 len: 0 microversion: 2.20 time: 0.027359 Oct 06 11:10:58.841731 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 371/730] 10.222.0.52 () {60 vars in 1259 bytes} [Thu Oct 6 11:10:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-970010329 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 11:10:59.495238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31830e9e-33d6-40f6-b059-e352c3a15452 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Action: 'create', calling method: .version_select at 0x7f92a6dddd30>, body: {"keypair": {"name": "tempest-keypair-1978804717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgByvltIQPLxh9+1X+ydBtxTAg6Fn+4Qs0dqz5aTTYNW6fV2dL0O0RKJJcziwtkt/bFppZ89DN4EchMI+bITGevaS30OazzAXtH4uODSFal36RVL55SPl2wYUTlC+PMaQ=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:10:59.516346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-31830e9e-33d6-40f6-b059-e352c3a15452 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Getting quotas for project 5b886dc365684ab1811d100eb5774619. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:10:59.520409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-31830e9e-33d6-40f6-b059-e352c3a15452 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Getting quotas for user 56835f0c8dc0416d9fa70662e40c856d and project 5b886dc365684ab1811d100eb5774619. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:10:59.546283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31830e9e-33d6-40f6-b059-e352c3a15452 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.055026 Oct 06 11:10:59.546886 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 360/731] 10.222.0.52 () {62 vars in 1200 bytes} [Thu Oct 6 11:10:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 11:11:00.753751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-125035073", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f38c588e-4101-4e6e-967d-e0ae7e6cf8d1"}], "security_groups": [{"name": "tempest-securitygroup--1835212677"}], "key_name": "tempest-keypair-1978804717", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:00.858969 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] validate_networks() for [('f38c588e-4101-4e6e-967d-e0ae7e6cf8d1', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:11:01.247898 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:11:01.248332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:11:01.248818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:11:01.249262 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:11:01.249779 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:11:01.258444 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:01.258920 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:01.259361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:01.260145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:01.260594 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:01.261183 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:01.279026 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Getting quotas for project 5b886dc365684ab1811d100eb5774619. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:11:01.282966 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Getting quotas for user 56835f0c8dc0416d9fa70662e40c856d and project 5b886dc365684ab1811d100eb5774619. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:11:01.295187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:11:01.297718 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:11:01.348456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38491fcb-b030-4a32-805a-b081ea4e12e9 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.599260 Oct 06 11:11:01.349288 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 372/732] 10.222.0.52 () {62 vars in 1188 bytes} [Thu Oct 6 11:11:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 11:11:01.361917 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b2bbb6d0-f416-4ab4-bf80-f6d12ee8fe2a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:01.362783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b2bbb6d0-f416-4ab4-bf80-f6d12ee8fe2a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:01.460203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b2bbb6d0-f416-4ab4-bf80-f6d12ee8fe2a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:01.468606 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b2bbb6d0-f416-4ab4-bf80-f6d12ee8fe2a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:01.471023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b2bbb6d0-f416-4ab4-bf80-f6d12ee8fe2a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:01.473145 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b2bbb6d0-f416-4ab4-bf80-f6d12ee8fe2a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1281 microversion: 2.20 time: 0.115346 Oct 06 11:11:01.474279 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 361/733] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:01 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1281 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:02.499715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:02.501081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:02.509899 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:02.510668 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:02.511334 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:02.512333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:02.512992 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:02.514862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:02.641381 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:02.651014 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:02.652649 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:02.654090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ff5f315-8dc5-4ab4-8576-ac6bc0082f98 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1333 microversion: 2.20 time: 0.159588 Oct 06 11:11:02.655104 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 373/734] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:02 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1333 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:03.692848 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:03.694050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:03.701331 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:03.701829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:03.702285 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:03.703007 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:03.703460 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:03.704160 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:03.782123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:03.790626 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:03.792099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:03.793205 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-90009777-df00-4908-8125-0b20eeeeb1dd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1339 microversion: 2.20 time: 0.116200 Oct 06 11:11:03.793759 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 362/735] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:03 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1339 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:04.819766 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:04.820408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:04.828049 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:04.828791 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:04.829430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:04.830348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:04.831112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:04.831693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:05.147416 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:05.156774 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:05.158544 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:05.159675 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3846cd59-5fb0-4303-b5ad-9ceb6a37256b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1407 microversion: 2.20 time: 0.345095 Oct 06 11:11:05.160478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 374/736] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:04 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:05.776145 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a848246b-6796-4dc6-b69f-aa729840b6fc req-676fe5db-6906-4722-a9c2-de44224e1626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16531807-aeec-439c-8671-699762bf520f", "tag": "d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:05.799678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a848246b-6796-4dc6-b69f-aa729840b6fc req-676fe5db-6906-4722-a9c2-de44224e1626 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:05.800208 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a848246b-6796-4dc6-b69f-aa729840b6fc req-676fe5db-6906-4722-a9c2-de44224e1626 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:05.800626 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a848246b-6796-4dc6-b69f-aa729840b6fc req-676fe5db-6906-4722-a9c2-de44224e1626 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:05.818736 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a848246b-6796-4dc6-b69f-aa729840b6fc req-676fe5db-6906-4722-a9c2-de44224e1626 service nova] Creating event network-changed:d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d for instance 16531807-aeec-439c-8671-699762bf520f on hv-cinder-86020 Oct 06 11:11:05.825268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a848246b-6796-4dc6-b69f-aa729840b6fc req-676fe5db-6906-4722-a9c2-de44224e1626 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054629 Oct 06 11:11:05.826558 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 363/737] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:06.189607 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:06.192484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:06.202879 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:06.204934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:06.205772 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:06.206690 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:06.207510 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:06.208679 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:06.372030 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:06.396738 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:06.404207 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:06.406398 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9af2f755-db2e-485c-9b31-90d17e4c0e9a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1407 microversion: 2.20 time: 0.225564 Oct 06 11:11:06.407070 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 375/738] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:06 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:07.433787 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:07.435383 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:07.442365 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:07.443122 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:07.444773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:07.450118 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:07.451410 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:07.452092 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:07.684503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:07.695690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:07.697536 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:07.698672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3c0bd61f-bfd5-494f-be9c-c45fa5d0149d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1407 microversion: 2.20 time: 0.270732 Oct 06 11:11:07.699263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 364/739] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:07 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:08.725554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:08.726785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:08.734800 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:08.735801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:08.736515 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:08.737451 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:08.738062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:08.738655 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:09.039795 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:09.055874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:09.058707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:09.059979 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ed3db2a4-83c6-4777-a789-e3a7e028a435 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1407 microversion: 2.20 time: 0.338635 Oct 06 11:11:09.083948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 376/740] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:08 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:10.089987 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:10.090563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:10.099479 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:10.100429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:10.100910 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:10.101766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:10.102280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:10.102702 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:10.332733 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:10.343575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:10.344620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:10.345924 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2b7cb40e-1dda-4e58-80b9-b6f7a811c26f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1407 microversion: 2.20 time: 0.260858 Oct 06 11:11:10.346691 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 365/741] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:10 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:11.371671 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:11.374016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:11.376495 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:11.377856 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:11.383657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:11.384474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:11.385168 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:11.386162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:11.391927 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:11.393692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:11.668267 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:11.679041 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:11.681450 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:11.682995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8133540-efca-49fc-8ba0-ae15d4fa8636 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1407 microversion: 2.20 time: 0.316065 Oct 06 11:11:11.684416 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 377/742] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:11 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:12.718023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:12.718763 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:12.731910 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:12.733209 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 11:11:12.733847 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Thu Oct 6 11:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f (ip 10.222.0.52) !!! Oct 06 11:11:12.737728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:12.738523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:12.739311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:12.740360 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:12.741035 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:12.741678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:13.317253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:13.333546 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:13.335023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:13.340117 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98ca58f6-bc82-4b21-b7b5-dd3c33f1dadf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1407 microversion: 2.20 time: 0.630452 Oct 06 11:11:13.342371 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 366/743] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:12 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1407 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:13.368360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-933ef8b5-0da8-45ef-bc54-7f75bcf496af req-0bc199db-de63-4a79-ae14-b6b1c5b9424b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16531807-aeec-439c-8671-699762bf520f", "name": "network-vif-plugged", "status": "completed", "tag": "d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:13.384348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-933ef8b5-0da8-45ef-bc54-7f75bcf496af req-0bc199db-de63-4a79-ae14-b6b1c5b9424b service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:13.385210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-933ef8b5-0da8-45ef-bc54-7f75bcf496af req-0bc199db-de63-4a79-ae14-b6b1c5b9424b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:13.391093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-933ef8b5-0da8-45ef-bc54-7f75bcf496af req-0bc199db-de63-4a79-ae14-b6b1c5b9424b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:13.412044 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-933ef8b5-0da8-45ef-bc54-7f75bcf496af req-0bc199db-de63-4a79-ae14-b6b1c5b9424b service nova] Creating event network-vif-plugged:d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d for instance 16531807-aeec-439c-8671-699762bf520f on hv-cinder-86020 Oct 06 11:11:13.417583 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-933ef8b5-0da8-45ef-bc54-7f75bcf496af req-0bc199db-de63-4a79-ae14-b6b1c5b9424b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.442306 Oct 06 11:11:13.418673 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 378/744] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:11:14.372167 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:14.372823 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:14.379783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:14.380300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:14.380732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:14.381848 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:14.382496 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:14.383107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:14.533105 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:14.541753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:14.544365 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:14.545917 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bdb38a69-3ea5-48fe-bf6b-d421b4b081c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1407 microversion: 2.20 time: 0.178308 Oct 06 11:11:14.547240 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 367/745] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:14 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:15.579454 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:15.580300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:15.586949 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:15.587524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:15.588071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:15.589130 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:15.589998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:15.590665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:15.831224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:15.846257 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:15.847968 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:15.849270 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73c5033e-3854-4e66-9fcc-4e8cc6da8005 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1407 microversion: 2.20 time: 0.276984 Oct 06 11:11:15.850308 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 379/746] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:15 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:11:16.877960 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:16.878568 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:16.888709 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:16.889520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:16.890155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:16.890870 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:16.891466 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:16.891917 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:17.055878 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:17.066344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:17.068176 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:17.069387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5da1b0d9-9e30-4c5a-b473-189f44676041 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1599 microversion: 2.20 time: 0.195357 Oct 06 11:11:17.069964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 368/747] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:11:16 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1599 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:11:17.101664 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fd75c0e-48c7-4127-8a80-198ffb8569ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:17.102272 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5fd75c0e-48c7-4127-8a80-198ffb8569ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:17.112653 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fd75c0e-48c7-4127-8a80-198ffb8569ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:17.113154 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fd75c0e-48c7-4127-8a80-198ffb8569ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:17.114038 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fd75c0e-48c7-4127-8a80-198ffb8569ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:17.114790 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fd75c0e-48c7-4127-8a80-198ffb8569ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:17.115254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fd75c0e-48c7-4127-8a80-198ffb8569ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:17.115685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fd75c0e-48c7-4127-8a80-198ffb8569ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:17.206804 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5fd75c0e-48c7-4127-8a80-198ffb8569ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.114862 Oct 06 11:11:17.207956 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 380/748] 10.222.0.52 () {60 vars in 1316 bytes} [Thu Oct 6 11:11:17 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 11:11:18.691719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-822b60b3-1453-46c9-b84f-ecb8a1b6826c req-fe91e204-2e4f-4091-bb15-7ca1d9040416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16531807-aeec-439c-8671-699762bf520f", "tag": "d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:18.703060 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-822b60b3-1453-46c9-b84f-ecb8a1b6826c req-fe91e204-2e4f-4091-bb15-7ca1d9040416 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:18.704020 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-822b60b3-1453-46c9-b84f-ecb8a1b6826c req-fe91e204-2e4f-4091-bb15-7ca1d9040416 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:18.704672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-822b60b3-1453-46c9-b84f-ecb8a1b6826c req-fe91e204-2e4f-4091-bb15-7ca1d9040416 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:18.728230 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-822b60b3-1453-46c9-b84f-ecb8a1b6826c req-fe91e204-2e4f-4091-bb15-7ca1d9040416 service nova] Creating event network-changed:d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d for instance 16531807-aeec-439c-8671-699762bf520f on hv-cinder-86020 Oct 06 11:11:18.736440 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-822b60b3-1453-46c9-b84f-ecb8a1b6826c req-fe91e204-2e4f-4091-bb15-7ca1d9040416 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047832 Oct 06 11:11:18.737719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 369/749] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:23.292360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc5b86c2-c947-4033-9247-8a30caa1ba07 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:23.292917 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc5b86c2-c947-4033-9247-8a30caa1ba07 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:23.296596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:23.300270 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5b86c2-c947-4033-9247-8a30caa1ba07 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:23.300821 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5b86c2-c947-4033-9247-8a30caa1ba07 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:23.301205 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5b86c2-c947-4033-9247-8a30caa1ba07 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:23.301866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5b86c2-c947-4033-9247-8a30caa1ba07 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:23.302367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5b86c2-c947-4033-9247-8a30caa1ba07 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:23.302725 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5b86c2-c947-4033-9247-8a30caa1ba07 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:23.306074 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:23.394183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1ffdf844-764f-43da-b4ad-9609aeef65f9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Action: 'create', calling method: .version_select at 0x7f92a6cfdb80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-356737777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqopGw/TmLFFGeexqEpg4gIFJSOtuPiQbRq/t5O/tuTgddIu0uUctC/YQRjROVI/ACuVKt/acgiqUgPirCad1yP3BME0H0NOxIL8B9VH7VKYFqYaeCxp0jJINZMiH5KAw=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:23.396701 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-bc5b86c2-c947-4033-9247-8a30caa1ba07 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lazy-loading 'services' on Instance uuid c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:11:23.400897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:23.415155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-1ffdf844-764f-43da-b4ad-9609aeef65f9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Getting quotas for project ca311e63675241eaaef42a8154e905ac. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:11:23.421665 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-1ffdf844-764f-43da-b4ad-9609aeef65f9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Getting quotas for user 5a5f8ee0a7fd4d7a9d34e211dabab48a and project ca311e63675241eaaef42a8154e905ac. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:11:23.445287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1ffdf844-764f-43da-b4ad-9609aeef65f9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056050 Oct 06 11:11:23.446099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 370/750] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Oct 6 11:11:23 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:23.478015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc5b86c2-c947-4033-9247-8a30caa1ba07 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments/0289f0d5-27cd-497e-a6a1-365b34b1fb4d" status: 202 len: 0 microversion: 2.1 time: 0.189893 Oct 06 11:11:23.478533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 381/751] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:11:23 2022] DELETE /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments/0289f0d5-27cd-497e-a6a1-365b34b1fb4d => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:11:23.491999 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fc4dfb16-6eb4-43a9-b448-252c0eeace45 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:23.494191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fc4dfb16-6eb4-43a9-b448-252c0eeace45 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:23.500987 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-84446312", "imageRef": "9723d0d5-ce51-4c08-b410-c9d5cd4da4f5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-356737777", "networks": [{"uuid": "0816dbad-e0a3-486e-94ba-be677095fd43"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:23.501606 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb16-6eb4-43a9-b448-252c0eeace45 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:23.502285 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb16-6eb4-43a9-b448-252c0eeace45 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:23.502762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb16-6eb4-43a9-b448-252c0eeace45 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:23.503609 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb16-6eb4-43a9-b448-252c0eeace45 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:23.504273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb16-6eb4-43a9-b448-252c0eeace45 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:23.504771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb16-6eb4-43a9-b448-252c0eeace45 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:23.507315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:23.539292 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fc4dfb16-6eb4-43a9-b448-252c0eeace45 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055578 Oct 06 11:11:23.539934 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 371/752] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:11:23 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:11:23.564533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] validate_networks() for [('0816dbad-e0a3-486e-94ba-be677095fd43', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:11:23.935772 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:11:23.936258 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:11:23.936787 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:11:23.937255 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:11:23.937680 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:11:23.946524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:23.947015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:23.947477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:23.948280 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:23.948743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:23.949179 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:23.966608 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Getting quotas for project ca311e63675241eaaef42a8154e905ac. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:11:23.970664 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Getting quotas for user 5a5f8ee0a7fd4d7a9d34e211dabab48a and project ca311e63675241eaaef42a8154e905ac. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:11:23.982281 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:11:23.984783 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9723d0d5-ce51-4c08-b410-c9d5cd4da4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:11:24.032810 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc60e945-e41b-4062-a493-ed05ff88f62f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536627 Oct 06 11:11:24.033374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 382/753] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:11:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 11:11:24.044185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0da5bf9d-ed63-43fd-9b94-392801d0070b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:24.044920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0da5bf9d-ed63-43fd-9b94-392801d0070b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:24.102009 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0da5bf9d-ed63-43fd-9b94-392801d0070b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:24.114902 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0da5bf9d-ed63-43fd-9b94-392801d0070b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1256 microversion: 2.1 time: 0.073413 Oct 06 11:11:24.128496 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 372/754] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:24 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1256 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:24.553143 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c55db302-08c6-43d9-839c-92266cef12d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:24.556018 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c55db302-08c6-43d9-839c-92266cef12d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:24.564514 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c55db302-08c6-43d9-839c-92266cef12d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:24.565100 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c55db302-08c6-43d9-839c-92266cef12d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:24.565547 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c55db302-08c6-43d9-839c-92266cef12d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:24.566444 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c55db302-08c6-43d9-839c-92266cef12d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:24.567717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c55db302-08c6-43d9-839c-92266cef12d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:24.568378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c55db302-08c6-43d9-839c-92266cef12d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:24.602094 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c55db302-08c6-43d9-839c-92266cef12d5 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054597 Oct 06 11:11:24.602659 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 383/755] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:11:24 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 11:11:24.679170 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5479ba72-c322-453c-acbb-7379bf158b89 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:24.679728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5479ba72-c322-453c-acbb-7379bf158b89 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:24.686080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5479ba72-c322-453c-acbb-7379bf158b89 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:24.686754 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5479ba72-c322-453c-acbb-7379bf158b89 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:24.687216 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5479ba72-c322-453c-acbb-7379bf158b89 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:24.688384 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5479ba72-c322-453c-acbb-7379bf158b89 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:24.689200 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5479ba72-c322-453c-acbb-7379bf158b89 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:24.689865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5479ba72-c322-453c-acbb-7379bf158b89 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:24.722172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5479ba72-c322-453c-acbb-7379bf158b89 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:11:24.802708 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5479ba72-c322-453c-acbb-7379bf158b89 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 204 len: 0 microversion: 2.1 time: 0.127050 Oct 06 11:11:24.803354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 373/756] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:11:24 2022] DELETE /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:11:24.813743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d81f3d3c-3732-4012-8419-2efa4d43eb96 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:24.815542 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d81f3d3c-3732-4012-8419-2efa4d43eb96 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:24.821831 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81f3d3c-3732-4012-8419-2efa4d43eb96 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:24.822329 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81f3d3c-3732-4012-8419-2efa4d43eb96 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:24.822772 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81f3d3c-3732-4012-8419-2efa4d43eb96 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:24.823481 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81f3d3c-3732-4012-8419-2efa4d43eb96 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:24.823989 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81f3d3c-3732-4012-8419-2efa4d43eb96 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:24.824419 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81f3d3c-3732-4012-8419-2efa4d43eb96 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:24.957774 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d81f3d3c-3732-4012-8419-2efa4d43eb96 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:24.965816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d81f3d3c-3732-4012-8419-2efa4d43eb96 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1689 microversion: 2.1 time: 0.157936 Oct 06 11:11:24.966394 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 384/757] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:24 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:25.140744 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9ff67c02-fef8-4f58-9bf0-829a902dc717 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:25.141429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9ff67c02-fef8-4f58-9bf0-829a902dc717 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:25.148994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ff67c02-fef8-4f58-9bf0-829a902dc717 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:25.149774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ff67c02-fef8-4f58-9bf0-829a902dc717 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:25.150504 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ff67c02-fef8-4f58-9bf0-829a902dc717 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:25.151648 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ff67c02-fef8-4f58-9bf0-829a902dc717 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:25.152449 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ff67c02-fef8-4f58-9bf0-829a902dc717 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:25.153173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ff67c02-fef8-4f58-9bf0-829a902dc717 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:25.218489 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9ff67c02-fef8-4f58-9bf0-829a902dc717 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:25.226658 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9ff67c02-fef8-4f58-9bf0-829a902dc717 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1308 microversion: 2.1 time: 0.091070 Oct 06 11:11:25.227334 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 374/758] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:25 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:25.989332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fbb48f0d-9348-44e1-9302-a209029b5fd3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:25.990018 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fbb48f0d-9348-44e1-9302-a209029b5fd3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:25.996496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbb48f0d-9348-44e1-9302-a209029b5fd3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:25.996990 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbb48f0d-9348-44e1-9302-a209029b5fd3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:25.998061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbb48f0d-9348-44e1-9302-a209029b5fd3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:25.998772 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbb48f0d-9348-44e1-9302-a209029b5fd3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:25.999227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbb48f0d-9348-44e1-9302-a209029b5fd3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:25.999654 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbb48f0d-9348-44e1-9302-a209029b5fd3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:26.126648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fbb48f0d-9348-44e1-9302-a209029b5fd3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:26.134237 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fbb48f0d-9348-44e1-9302-a209029b5fd3 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1689 microversion: 2.1 time: 0.148790 Oct 06 11:11:26.134799 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 385/759] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:25 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:26.256581 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e713d1a-53f9-4ed7-bd0e-cb5b12fb463c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:26.257158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e713d1a-53f9-4ed7-bd0e-cb5b12fb463c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:26.264217 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e713d1a-53f9-4ed7-bd0e-cb5b12fb463c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:26.264707 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e713d1a-53f9-4ed7-bd0e-cb5b12fb463c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:26.265147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e713d1a-53f9-4ed7-bd0e-cb5b12fb463c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:26.265844 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e713d1a-53f9-4ed7-bd0e-cb5b12fb463c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:26.266297 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e713d1a-53f9-4ed7-bd0e-cb5b12fb463c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:26.266724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e713d1a-53f9-4ed7-bd0e-cb5b12fb463c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:26.326292 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e713d1a-53f9-4ed7-bd0e-cb5b12fb463c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:26.333797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e713d1a-53f9-4ed7-bd0e-cb5b12fb463c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1308 microversion: 2.1 time: 0.081123 Oct 06 11:11:26.334363 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 375/760] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:26 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1308 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:27.158607 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79b3bc3e-d42f-41b4-9637-780e39052b5e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:27.159173 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-79b3bc3e-d42f-41b4-9637-780e39052b5e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:27.165445 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79b3bc3e-d42f-41b4-9637-780e39052b5e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:27.166211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79b3bc3e-d42f-41b4-9637-780e39052b5e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:27.166644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79b3bc3e-d42f-41b4-9637-780e39052b5e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:27.167331 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79b3bc3e-d42f-41b4-9637-780e39052b5e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:27.167783 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79b3bc3e-d42f-41b4-9637-780e39052b5e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:27.168233 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79b3bc3e-d42f-41b4-9637-780e39052b5e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:27.299317 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-79b3bc3e-d42f-41b4-9637-780e39052b5e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:27.306941 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79b3bc3e-d42f-41b4-9637-780e39052b5e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1689 microversion: 2.1 time: 0.152276 Oct 06 11:11:27.307503 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 386/761] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:27 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:27.356093 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40420d98-2bf9-4413-8275-08614d06a32e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:27.357343 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40420d98-2bf9-4413-8275-08614d06a32e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:27.363607 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40420d98-2bf9-4413-8275-08614d06a32e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:27.364117 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40420d98-2bf9-4413-8275-08614d06a32e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:27.364558 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40420d98-2bf9-4413-8275-08614d06a32e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:27.365240 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40420d98-2bf9-4413-8275-08614d06a32e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:27.365691 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40420d98-2bf9-4413-8275-08614d06a32e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:27.366107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40420d98-2bf9-4413-8275-08614d06a32e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:27.430044 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-40420d98-2bf9-4413-8275-08614d06a32e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:27.438129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40420d98-2bf9-4413-8275-08614d06a32e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1308 microversion: 2.1 time: 0.085916 Oct 06 11:11:27.438698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 376/762] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:27 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1308 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:28.330067 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b7be336-d754-48ec-8dbe-e98df66802c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:28.330608 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b7be336-d754-48ec-8dbe-e98df66802c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:28.337060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7be336-d754-48ec-8dbe-e98df66802c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:28.337549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7be336-d754-48ec-8dbe-e98df66802c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:28.337989 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7be336-d754-48ec-8dbe-e98df66802c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:28.338685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7be336-d754-48ec-8dbe-e98df66802c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:28.339142 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7be336-d754-48ec-8dbe-e98df66802c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:28.339588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7be336-d754-48ec-8dbe-e98df66802c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:28.460611 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c81fd245-df0a-4d9f-b117-0f93898cd7d6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:28.461230 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c81fd245-df0a-4d9f-b117-0f93898cd7d6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:28.466351 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b7be336-d754-48ec-8dbe-e98df66802c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:28.468154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c81fd245-df0a-4d9f-b117-0f93898cd7d6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:28.468648 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c81fd245-df0a-4d9f-b117-0f93898cd7d6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:28.469086 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c81fd245-df0a-4d9f-b117-0f93898cd7d6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:28.469796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c81fd245-df0a-4d9f-b117-0f93898cd7d6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:28.470243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c81fd245-df0a-4d9f-b117-0f93898cd7d6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:28.470667 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c81fd245-df0a-4d9f-b117-0f93898cd7d6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:28.474068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b7be336-d754-48ec-8dbe-e98df66802c2 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1689 microversion: 2.1 time: 0.147975 Oct 06 11:11:28.474636 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 387/763] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:28 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:28.536996 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c81fd245-df0a-4d9f-b117-0f93898cd7d6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:28.545305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c81fd245-df0a-4d9f-b117-0f93898cd7d6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1308 microversion: 2.1 time: 0.088577 Oct 06 11:11:28.545874 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 377/764] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:28 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1308 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:29.502860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49a05fe4-e666-4570-87ee-77c1d88044bb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:29.505257 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49a05fe4-e666-4570-87ee-77c1d88044bb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:29.516187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49a05fe4-e666-4570-87ee-77c1d88044bb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:29.517664 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49a05fe4-e666-4570-87ee-77c1d88044bb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:29.518401 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49a05fe4-e666-4570-87ee-77c1d88044bb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:29.519685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49a05fe4-e666-4570-87ee-77c1d88044bb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:29.520663 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49a05fe4-e666-4570-87ee-77c1d88044bb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:29.521384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49a05fe4-e666-4570-87ee-77c1d88044bb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:29.569050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-179056fa-cb2a-4da2-8cf5-a544766eb8e2 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:29.570445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-179056fa-cb2a-4da2-8cf5-a544766eb8e2 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:29.583673 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-179056fa-cb2a-4da2-8cf5-a544766eb8e2 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:29.588758 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-179056fa-cb2a-4da2-8cf5-a544766eb8e2 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:29.590705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-179056fa-cb2a-4da2-8cf5-a544766eb8e2 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:29.596684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-179056fa-cb2a-4da2-8cf5-a544766eb8e2 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:29.598265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-179056fa-cb2a-4da2-8cf5-a544766eb8e2 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:29.598931 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-179056fa-cb2a-4da2-8cf5-a544766eb8e2 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:29.733734 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-49a05fe4-e666-4570-87ee-77c1d88044bb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:29.745190 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49a05fe4-e666-4570-87ee-77c1d88044bb tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.249664 Oct 06 11:11:29.749905 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 388/765] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:29 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:30.150509 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-00d4732c-36f8-422f-8fe9-a5a2c1a8859e req-420dbacd-0381-47b1-9cfc-0c0e29e328e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a", "name": "network-vif-deleted", "tag": "ce07790b-c95e-4fab-b759-f35f2b34ca5f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:30.198805 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-00d4732c-36f8-422f-8fe9-a5a2c1a8859e req-420dbacd-0381-47b1-9cfc-0c0e29e328e0 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:30.202888 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-00d4732c-36f8-422f-8fe9-a5a2c1a8859e req-420dbacd-0381-47b1-9cfc-0c0e29e328e0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:30.203342 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-00d4732c-36f8-422f-8fe9-a5a2c1a8859e req-420dbacd-0381-47b1-9cfc-0c0e29e328e0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:30.228419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-179056fa-cb2a-4da2-8cf5-a544766eb8e2 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:30.246675 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-179056fa-cb2a-4da2-8cf5-a544766eb8e2 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.682099 Oct 06 11:11:30.253352 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 378/766] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:29 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:30.261261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-00d4732c-36f8-422f-8fe9-a5a2c1a8859e req-420dbacd-0381-47b1-9cfc-0c0e29e328e0 service nova] Creating event network-vif-deleted:ce07790b-c95e-4fab-b759-f35f2b34ca5f for instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a on hv-cinder-86020 Oct 06 11:11:30.286116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-00d4732c-36f8-422f-8fe9-a5a2c1a8859e req-420dbacd-0381-47b1-9cfc-0c0e29e328e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139782 Oct 06 11:11:30.290051 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 389/767] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:30.780149 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a303e48-1959-415f-8c77-075e0f855bd0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:30.780876 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3a303e48-1959-415f-8c77-075e0f855bd0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:30.787083 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a303e48-1959-415f-8c77-075e0f855bd0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:30.787799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a303e48-1959-415f-8c77-075e0f855bd0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:30.788267 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a303e48-1959-415f-8c77-075e0f855bd0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:30.788977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a303e48-1959-415f-8c77-075e0f855bd0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:30.789429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a303e48-1959-415f-8c77-075e0f855bd0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:30.789856 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a303e48-1959-415f-8c77-075e0f855bd0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:30.878304 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3a303e48-1959-415f-8c77-075e0f855bd0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:30.891541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3a303e48-1959-415f-8c77-075e0f855bd0 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.117439 Oct 06 11:11:30.893096 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 379/768] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:30 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:31.275376 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c02614c9-d5cc-40e7-9417-40b385365e0b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:31.276146 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c02614c9-d5cc-40e7-9417-40b385365e0b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:31.287441 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c02614c9-d5cc-40e7-9417-40b385365e0b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:31.288375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c02614c9-d5cc-40e7-9417-40b385365e0b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:31.288998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c02614c9-d5cc-40e7-9417-40b385365e0b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:31.289913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c02614c9-d5cc-40e7-9417-40b385365e0b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:31.290669 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c02614c9-d5cc-40e7-9417-40b385365e0b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:31.291406 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c02614c9-d5cc-40e7-9417-40b385365e0b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:31.462500 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c02614c9-d5cc-40e7-9417-40b385365e0b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:31.470823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c02614c9-d5cc-40e7-9417-40b385365e0b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.200580 Oct 06 11:11:31.471456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 390/769] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:31 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:31.914641 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-beafc813-3da7-4aca-b75a-5bb29a6ba244 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:31.915254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-beafc813-3da7-4aca-b75a-5bb29a6ba244 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:31.922615 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beafc813-3da7-4aca-b75a-5bb29a6ba244 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:31.923101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beafc813-3da7-4aca-b75a-5bb29a6ba244 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:31.923534 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beafc813-3da7-4aca-b75a-5bb29a6ba244 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:31.924268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beafc813-3da7-4aca-b75a-5bb29a6ba244 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:31.924721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beafc813-3da7-4aca-b75a-5bb29a6ba244 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:31.925139 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beafc813-3da7-4aca-b75a-5bb29a6ba244 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:31.988789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-beafc813-3da7-4aca-b75a-5bb29a6ba244 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:31.996818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-beafc813-3da7-4aca-b75a-5bb29a6ba244 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.085838 Oct 06 11:11:31.998767 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 380/770] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:31 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:32.494064 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4c1b19f-1ec3-49e2-8223-3ba9335b123f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:32.496230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c4c1b19f-1ec3-49e2-8223-3ba9335b123f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:32.502794 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c1b19f-1ec3-49e2-8223-3ba9335b123f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:32.503294 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c1b19f-1ec3-49e2-8223-3ba9335b123f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:32.503737 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c1b19f-1ec3-49e2-8223-3ba9335b123f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:32.504487 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c1b19f-1ec3-49e2-8223-3ba9335b123f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:32.504945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c1b19f-1ec3-49e2-8223-3ba9335b123f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:32.505376 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c1b19f-1ec3-49e2-8223-3ba9335b123f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:32.662256 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c4c1b19f-1ec3-49e2-8223-3ba9335b123f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:32.676430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c4c1b19f-1ec3-49e2-8223-3ba9335b123f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.186157 Oct 06 11:11:32.691860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 391/771] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:32 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:32.692137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7b050e48-b3f7-4d07-b845-7bf151708225 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:32.694278 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7b050e48-b3f7-4d07-b845-7bf151708225 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:32.701152 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b050e48-b3f7-4d07-b845-7bf151708225 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:32.701728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b050e48-b3f7-4d07-b845-7bf151708225 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:32.702326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b050e48-b3f7-4d07-b845-7bf151708225 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:32.703246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b050e48-b3f7-4d07-b845-7bf151708225 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:32.704045 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b050e48-b3f7-4d07-b845-7bf151708225 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:32.704568 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b050e48-b3f7-4d07-b845-7bf151708225 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:32.736074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7b050e48-b3f7-4d07-b845-7bf151708225 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048279 Oct 06 11:11:32.736782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 381/772] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:11:32 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 11:11:32.803750 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0a449f85-c4e7-48eb-9d51-6521a59dba37 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:32.804131 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0a449f85-c4e7-48eb-9d51-6521a59dba37 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:32.810696 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a449f85-c4e7-48eb-9d51-6521a59dba37 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:32.811499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a449f85-c4e7-48eb-9d51-6521a59dba37 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:32.811977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a449f85-c4e7-48eb-9d51-6521a59dba37 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:32.812700 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a449f85-c4e7-48eb-9d51-6521a59dba37 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:32.813166 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a449f85-c4e7-48eb-9d51-6521a59dba37 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:32.813600 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a449f85-c4e7-48eb-9d51-6521a59dba37 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:32.839570 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0a449f85-c4e7-48eb-9d51-6521a59dba37 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:11:32.920101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0a449f85-c4e7-48eb-9d51-6521a59dba37 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 204 len: 0 microversion: 2.1 time: 0.119823 Oct 06 11:11:32.920744 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 392/773] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:11:32 2022] DELETE /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:11:32.929107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-644d5f21-5bbf-4fe9-bc9c-18c88eb0872a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:32.929723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-644d5f21-5bbf-4fe9-bc9c-18c88eb0872a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:32.936982 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-644d5f21-5bbf-4fe9-bc9c-18c88eb0872a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:32.937613 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-644d5f21-5bbf-4fe9-bc9c-18c88eb0872a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:32.938060 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-644d5f21-5bbf-4fe9-bc9c-18c88eb0872a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:32.938764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-644d5f21-5bbf-4fe9-bc9c-18c88eb0872a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:32.939227 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-644d5f21-5bbf-4fe9-bc9c-18c88eb0872a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:32.939670 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-644d5f21-5bbf-4fe9-bc9c-18c88eb0872a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:33.023865 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a5871e7-04cd-420d-872a-4a4f8e5cac74 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:33.024665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a5871e7-04cd-420d-872a-4a4f8e5cac74 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:33.031544 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a5871e7-04cd-420d-872a-4a4f8e5cac74 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:33.032095 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a5871e7-04cd-420d-872a-4a4f8e5cac74 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:33.032537 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a5871e7-04cd-420d-872a-4a4f8e5cac74 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:33.033249 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a5871e7-04cd-420d-872a-4a4f8e5cac74 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:33.033708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a5871e7-04cd-420d-872a-4a4f8e5cac74 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:33.034136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a5871e7-04cd-420d-872a-4a4f8e5cac74 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:33.103908 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a5871e7-04cd-420d-872a-4a4f8e5cac74 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:33.110070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-644d5f21-5bbf-4fe9-bc9c-18c88eb0872a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:33.115807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a5871e7-04cd-420d-872a-4a4f8e5cac74 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.097586 Oct 06 11:11:33.117109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 393/774] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:33 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:33.119369 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-644d5f21-5bbf-4fe9-bc9c-18c88eb0872a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1671 microversion: 2.1 time: 0.194140 Oct 06 11:11:33.120321 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 382/775] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:32 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1671 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:33.700167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d9df5391-7257-4827-b0b5-874cd19e492c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:33.700798 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d9df5391-7257-4827-b0b5-874cd19e492c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:33.708366 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9df5391-7257-4827-b0b5-874cd19e492c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:33.709096 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9df5391-7257-4827-b0b5-874cd19e492c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:33.709533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9df5391-7257-4827-b0b5-874cd19e492c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:33.710436 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9df5391-7257-4827-b0b5-874cd19e492c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:33.710895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9df5391-7257-4827-b0b5-874cd19e492c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:33.711642 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9df5391-7257-4827-b0b5-874cd19e492c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:33.858563 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d9df5391-7257-4827-b0b5-874cd19e492c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:33.866730 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d9df5391-7257-4827-b0b5-874cd19e492c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.170480 Oct 06 11:11:33.867497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 394/776] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:33 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:34.141398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-557101ab-6719-42ff-a38d-37bbff6bdb05 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:34.141998 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-557101ab-6719-42ff-a38d-37bbff6bdb05 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:34.144400 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-07d27825-7320-4697-a734-c046b2b45bfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:34.144536 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:34.145117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-07d27825-7320-4697-a734-c046b2b45bfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:34.147424 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:34.148187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:34.149893 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557101ab-6719-42ff-a38d-37bbff6bdb05 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:34.150393 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557101ab-6719-42ff-a38d-37bbff6bdb05 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:34.151699 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557101ab-6719-42ff-a38d-37bbff6bdb05 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:34.152649 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557101ab-6719-42ff-a38d-37bbff6bdb05 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:34.153311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557101ab-6719-42ff-a38d-37bbff6bdb05 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:34.153941 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557101ab-6719-42ff-a38d-37bbff6bdb05 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:34.154094 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07d27825-7320-4697-a734-c046b2b45bfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:34.154685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07d27825-7320-4697-a734-c046b2b45bfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:34.155238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07d27825-7320-4697-a734-c046b2b45bfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:34.156214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07d27825-7320-4697-a734-c046b2b45bfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:34.156751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07d27825-7320-4697-a734-c046b2b45bfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:34.157248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07d27825-7320-4697-a734-c046b2b45bfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:34.222924 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-557101ab-6719-42ff-a38d-37bbff6bdb05 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:34.233688 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-557101ab-6719-42ff-a38d-37bbff6bdb05 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.096002 Oct 06 11:11:34.234664 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 383/777] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:34 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:34.302417 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-07d27825-7320-4697-a734-c046b2b45bfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:34.312023 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-07d27825-7320-4697-a734-c046b2b45bfa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1671 microversion: 2.1 time: 0.171878 Oct 06 11:11:34.316495 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 395/778] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:34 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:34.890583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ce8aaa7-ab5e-4549-bf8f-e5c52dc796a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:34.891387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ce8aaa7-ab5e-4549-bf8f-e5c52dc796a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:34.898899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ce8aaa7-ab5e-4549-bf8f-e5c52dc796a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:34.899399 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ce8aaa7-ab5e-4549-bf8f-e5c52dc796a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:34.899860 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ce8aaa7-ab5e-4549-bf8f-e5c52dc796a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:34.900614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ce8aaa7-ab5e-4549-bf8f-e5c52dc796a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:34.901220 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ce8aaa7-ab5e-4549-bf8f-e5c52dc796a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:34.901663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ce8aaa7-ab5e-4549-bf8f-e5c52dc796a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:35.048290 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ce8aaa7-ab5e-4549-bf8f-e5c52dc796a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:35.062266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ce8aaa7-ab5e-4549-bf8f-e5c52dc796a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.175184 Oct 06 11:11:35.063132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 384/779] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:34 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:35.258171 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8741d20d-ad7f-4b05-9501-f591178f04c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:35.258768 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8741d20d-ad7f-4b05-9501-f591178f04c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:35.265653 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8741d20d-ad7f-4b05-9501-f591178f04c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:35.266140 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8741d20d-ad7f-4b05-9501-f591178f04c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:35.266571 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8741d20d-ad7f-4b05-9501-f591178f04c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:35.267267 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8741d20d-ad7f-4b05-9501-f591178f04c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:35.267719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8741d20d-ad7f-4b05-9501-f591178f04c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:35.268182 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8741d20d-ad7f-4b05-9501-f591178f04c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:35.336836 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8741d20d-ad7f-4b05-9501-f591178f04c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:35.338995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:35.342817 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-af5c44e2-6b9c-4984-b0ec-51b4cda2b692 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:35.343675 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-af5c44e2-6b9c-4984-b0ec-51b4cda2b692 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:35.347353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8741d20d-ad7f-4b05-9501-f591178f04c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.092738 Oct 06 11:11:35.352617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af5c44e2-6b9c-4984-b0ec-51b4cda2b692 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:35.353433 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af5c44e2-6b9c-4984-b0ec-51b4cda2b692 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:35.354101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af5c44e2-6b9c-4984-b0ec-51b4cda2b692 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:35.355053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af5c44e2-6b9c-4984-b0ec-51b4cda2b692 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:35.355736 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af5c44e2-6b9c-4984-b0ec-51b4cda2b692 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:35.356409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af5c44e2-6b9c-4984-b0ec-51b4cda2b692 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:35.363184 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 396/780] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:35 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:35.505112 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-af5c44e2-6b9c-4984-b0ec-51b4cda2b692 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:35.513256 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-af5c44e2-6b9c-4984-b0ec-51b4cda2b692 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1671 microversion: 2.1 time: 0.175321 Oct 06 11:11:35.513764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 385/781] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:35 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:36.085908 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e7ef467-881a-4b8e-a188-922e9db4f6c1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:36.086521 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e7ef467-881a-4b8e-a188-922e9db4f6c1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:36.094157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7ef467-881a-4b8e-a188-922e9db4f6c1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:36.094685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7ef467-881a-4b8e-a188-922e9db4f6c1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:36.095092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7ef467-881a-4b8e-a188-922e9db4f6c1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:36.095808 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7ef467-881a-4b8e-a188-922e9db4f6c1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:36.096460 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7ef467-881a-4b8e-a188-922e9db4f6c1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:36.096879 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7ef467-881a-4b8e-a188-922e9db4f6c1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:36.248253 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e7ef467-881a-4b8e-a188-922e9db4f6c1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:36.256999 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e7ef467-881a-4b8e-a188-922e9db4f6c1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.174961 Oct 06 11:11:36.257576 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 397/782] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:36 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:36.370693 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-44939a6c-2db9-4752-905b-14faba659e8b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:36.371358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-44939a6c-2db9-4752-905b-14faba659e8b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:36.379050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44939a6c-2db9-4752-905b-14faba659e8b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:36.379855 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44939a6c-2db9-4752-905b-14faba659e8b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:36.380493 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44939a6c-2db9-4752-905b-14faba659e8b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:36.381538 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44939a6c-2db9-4752-905b-14faba659e8b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:36.382194 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44939a6c-2db9-4752-905b-14faba659e8b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:36.382618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44939a6c-2db9-4752-905b-14faba659e8b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:36.450680 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-44939a6c-2db9-4752-905b-14faba659e8b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:36.460366 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-44939a6c-2db9-4752-905b-14faba659e8b tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.093567 Oct 06 11:11:36.460948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 386/783] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:36 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:36.538080 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d17c492-7fa4-40c6-8397-0c71e88e3545 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:36.538711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d17c492-7fa4-40c6-8397-0c71e88e3545 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:36.545010 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d17c492-7fa4-40c6-8397-0c71e88e3545 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:36.546013 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d17c492-7fa4-40c6-8397-0c71e88e3545 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:36.546455 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d17c492-7fa4-40c6-8397-0c71e88e3545 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:36.547160 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d17c492-7fa4-40c6-8397-0c71e88e3545 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:36.547632 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d17c492-7fa4-40c6-8397-0c71e88e3545 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:36.548076 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d17c492-7fa4-40c6-8397-0c71e88e3545 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:36.687914 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d17c492-7fa4-40c6-8397-0c71e88e3545 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:36.695766 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d17c492-7fa4-40c6-8397-0c71e88e3545 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1671 microversion: 2.1 time: 0.161596 Oct 06 11:11:36.696391 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 398/784] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:36 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:37.280422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-336ae4d2-63c5-46ed-bc15-66f17cde7225 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:37.281033 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-336ae4d2-63c5-46ed-bc15-66f17cde7225 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:37.287920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336ae4d2-63c5-46ed-bc15-66f17cde7225 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:37.288191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336ae4d2-63c5-46ed-bc15-66f17cde7225 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:37.288953 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336ae4d2-63c5-46ed-bc15-66f17cde7225 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:37.289253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336ae4d2-63c5-46ed-bc15-66f17cde7225 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:37.289705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336ae4d2-63c5-46ed-bc15-66f17cde7225 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:37.290146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-336ae4d2-63c5-46ed-bc15-66f17cde7225 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:37.292970 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:37.443151 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-336ae4d2-63c5-46ed-bc15-66f17cde7225 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:37.450970 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-336ae4d2-63c5-46ed-bc15-66f17cde7225 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.175011 Oct 06 11:11:37.452145 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 387/785] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:37 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:37.483703 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a7528ba-976e-4661-b2e1-b6e2bba2888d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:37.484376 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a7528ba-976e-4661-b2e1-b6e2bba2888d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:37.490361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a7528ba-976e-4661-b2e1-b6e2bba2888d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:37.490849 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a7528ba-976e-4661-b2e1-b6e2bba2888d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:37.491287 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a7528ba-976e-4661-b2e1-b6e2bba2888d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:37.492027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a7528ba-976e-4661-b2e1-b6e2bba2888d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:37.492481 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a7528ba-976e-4661-b2e1-b6e2bba2888d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:37.493120 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a7528ba-976e-4661-b2e1-b6e2bba2888d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:37.555620 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a7528ba-976e-4661-b2e1-b6e2bba2888d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:37.564940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a7528ba-976e-4661-b2e1-b6e2bba2888d tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.085118 Oct 06 11:11:37.565692 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 399/786] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:37 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:37.719599 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9afa813c-a4e7-43fe-a2d9-5135d99b1364 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:37.720179 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9afa813c-a4e7-43fe-a2d9-5135d99b1364 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:37.726137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9afa813c-a4e7-43fe-a2d9-5135d99b1364 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:37.726655 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9afa813c-a4e7-43fe-a2d9-5135d99b1364 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:37.727100 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9afa813c-a4e7-43fe-a2d9-5135d99b1364 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:37.727801 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9afa813c-a4e7-43fe-a2d9-5135d99b1364 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:37.728287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9afa813c-a4e7-43fe-a2d9-5135d99b1364 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:37.728719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9afa813c-a4e7-43fe-a2d9-5135d99b1364 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:37.861008 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9afa813c-a4e7-43fe-a2d9-5135d99b1364 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:37.869435 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9afa813c-a4e7-43fe-a2d9-5135d99b1364 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1671 microversion: 2.1 time: 0.154633 Oct 06 11:11:37.870056 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 388/787] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:37 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:38.474352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-005d0db9-8ea1-4816-b517-539e2c260b1b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:38.474969 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-005d0db9-8ea1-4816-b517-539e2c260b1b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:38.480827 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-005d0db9-8ea1-4816-b517-539e2c260b1b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:38.481317 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-005d0db9-8ea1-4816-b517-539e2c260b1b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:38.481758 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-005d0db9-8ea1-4816-b517-539e2c260b1b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:38.482458 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-005d0db9-8ea1-4816-b517-539e2c260b1b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:38.483659 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-005d0db9-8ea1-4816-b517-539e2c260b1b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:38.484288 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-005d0db9-8ea1-4816-b517-539e2c260b1b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:38.588776 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08f41ab7-d4de-4a1b-a622-42da33a18335 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:38.589397 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08f41ab7-d4de-4a1b-a622-42da33a18335 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:38.596319 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08f41ab7-d4de-4a1b-a622-42da33a18335 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:38.596814 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08f41ab7-d4de-4a1b-a622-42da33a18335 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:38.597255 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08f41ab7-d4de-4a1b-a622-42da33a18335 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:38.597982 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08f41ab7-d4de-4a1b-a622-42da33a18335 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:38.598419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08f41ab7-d4de-4a1b-a622-42da33a18335 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:38.598847 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08f41ab7-d4de-4a1b-a622-42da33a18335 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:38.614476 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-005d0db9-8ea1-4816-b517-539e2c260b1b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:38.622012 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-005d0db9-8ea1-4816-b517-539e2c260b1b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.151562 Oct 06 11:11:38.622586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 400/788] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:38 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:38.660438 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-08f41ab7-d4de-4a1b-a622-42da33a18335 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:38.668000 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08f41ab7-d4de-4a1b-a622-42da33a18335 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.083055 Oct 06 11:11:38.668572 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 389/789] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:38 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:38.893898 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b69fa1b9-7c51-4f00-a6f5-6777fc788a60 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:38.894506 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b69fa1b9-7c51-4f00-a6f5-6777fc788a60 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:38.900734 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b69fa1b9-7c51-4f00-a6f5-6777fc788a60 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:38.901220 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b69fa1b9-7c51-4f00-a6f5-6777fc788a60 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:38.901658 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b69fa1b9-7c51-4f00-a6f5-6777fc788a60 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:38.902346 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b69fa1b9-7c51-4f00-a6f5-6777fc788a60 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:38.902797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b69fa1b9-7c51-4f00-a6f5-6777fc788a60 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:38.903219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b69fa1b9-7c51-4f00-a6f5-6777fc788a60 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:39.028995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b69fa1b9-7c51-4f00-a6f5-6777fc788a60 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:39.037477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b69fa1b9-7c51-4f00-a6f5-6777fc788a60 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1671 microversion: 2.1 time: 0.147443 Oct 06 11:11:39.038045 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 401/790] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:38 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:39.645089 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23692659-593f-497f-9f7e-32af9acbe298 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:39.646546 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-23692659-593f-497f-9f7e-32af9acbe298 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:39.652353 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23692659-593f-497f-9f7e-32af9acbe298 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:39.652835 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23692659-593f-497f-9f7e-32af9acbe298 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:39.653274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23692659-593f-497f-9f7e-32af9acbe298 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:39.653963 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23692659-593f-497f-9f7e-32af9acbe298 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:39.654413 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23692659-593f-497f-9f7e-32af9acbe298 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:39.654868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23692659-593f-497f-9f7e-32af9acbe298 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:39.691849 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6fd97df8-f5b2-49a7-b2bc-b877ffe4a1b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:39.692519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6fd97df8-f5b2-49a7-b2bc-b877ffe4a1b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:39.698996 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd97df8-f5b2-49a7-b2bc-b877ffe4a1b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:39.699490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd97df8-f5b2-49a7-b2bc-b877ffe4a1b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:39.699962 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd97df8-f5b2-49a7-b2bc-b877ffe4a1b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:39.700677 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd97df8-f5b2-49a7-b2bc-b877ffe4a1b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:39.701141 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd97df8-f5b2-49a7-b2bc-b877ffe4a1b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:39.701570 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd97df8-f5b2-49a7-b2bc-b877ffe4a1b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:39.764014 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6fd97df8-f5b2-49a7-b2bc-b877ffe4a1b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:39.771695 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6fd97df8-f5b2-49a7-b2bc-b877ffe4a1b9 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.083663 Oct 06 11:11:39.772804 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 402/791] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:39 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:39.782494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-23692659-593f-497f-9f7e-32af9acbe298 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:39.790119 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23692659-593f-497f-9f7e-32af9acbe298 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.149059 Oct 06 11:11:39.790670 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 390/792] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:39 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:40.060726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19389d42-4a77-4a9c-ab9c-0dafdb126664 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:40.061882 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-19389d42-4a77-4a9c-ab9c-0dafdb126664 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:40.067813 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19389d42-4a77-4a9c-ab9c-0dafdb126664 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:40.068348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19389d42-4a77-4a9c-ab9c-0dafdb126664 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:40.068787 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19389d42-4a77-4a9c-ab9c-0dafdb126664 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:40.069479 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19389d42-4a77-4a9c-ab9c-0dafdb126664 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:40.069935 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19389d42-4a77-4a9c-ab9c-0dafdb126664 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:40.070361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19389d42-4a77-4a9c-ab9c-0dafdb126664 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:40.200844 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-19389d42-4a77-4a9c-ab9c-0dafdb126664 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:40.209268 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19389d42-4a77-4a9c-ab9c-0dafdb126664 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1671 microversion: 2.1 time: 0.152388 Oct 06 11:11:40.209836 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 403/793] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:40 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:40.794313 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82785798-c601-4027-83c5-b05e59d12671 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:40.794922 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82785798-c601-4027-83c5-b05e59d12671 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:40.801372 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82785798-c601-4027-83c5-b05e59d12671 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:40.801850 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82785798-c601-4027-83c5-b05e59d12671 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:40.802280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82785798-c601-4027-83c5-b05e59d12671 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:40.802965 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82785798-c601-4027-83c5-b05e59d12671 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:40.803412 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82785798-c601-4027-83c5-b05e59d12671 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:40.803831 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82785798-c601-4027-83c5-b05e59d12671 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:40.813726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1ceb0e7-5bf2-4558-a012-e5e872db5f1f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:40.814339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1ceb0e7-5bf2-4558-a012-e5e872db5f1f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:40.820390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ceb0e7-5bf2-4558-a012-e5e872db5f1f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:40.820875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ceb0e7-5bf2-4558-a012-e5e872db5f1f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:40.821308 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ceb0e7-5bf2-4558-a012-e5e872db5f1f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:40.821999 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ceb0e7-5bf2-4558-a012-e5e872db5f1f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:40.822454 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ceb0e7-5bf2-4558-a012-e5e872db5f1f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:40.822876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ceb0e7-5bf2-4558-a012-e5e872db5f1f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:40.871448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-82785798-c601-4027-83c5-b05e59d12671 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:40.880379 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82785798-c601-4027-83c5-b05e59d12671 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1621 microversion: 2.1 time: 0.089824 Oct 06 11:11:40.880945 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 391/794] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:40 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1621 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:40.950543 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1ceb0e7-5bf2-4558-a012-e5e872db5f1f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:40.958861 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1ceb0e7-5bf2-4558-a012-e5e872db5f1f tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.149745 Oct 06 11:11:40.959429 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 404/795] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:40 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:41.232597 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e3ef5c80-a3d2-4972-88dd-37ffac3e0106 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:41.233238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e3ef5c80-a3d2-4972-88dd-37ffac3e0106 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:41.240310 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3ef5c80-a3d2-4972-88dd-37ffac3e0106 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:41.240797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3ef5c80-a3d2-4972-88dd-37ffac3e0106 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:41.241232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3ef5c80-a3d2-4972-88dd-37ffac3e0106 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:41.241921 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3ef5c80-a3d2-4972-88dd-37ffac3e0106 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:41.242375 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3ef5c80-a3d2-4972-88dd-37ffac3e0106 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:41.242806 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3ef5c80-a3d2-4972-88dd-37ffac3e0106 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:41.371533 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e3ef5c80-a3d2-4972-88dd-37ffac3e0106 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:41.379298 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e3ef5c80-a3d2-4972-88dd-37ffac3e0106 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1671 microversion: 2.1 time: 0.150706 Oct 06 11:11:41.379876 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 392/796] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:41 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:41.904419 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-284a5b2a-8fe8-4d0e-95b3-9fa8262538ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:41.905014 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-284a5b2a-8fe8-4d0e-95b3-9fa8262538ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:41.912162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284a5b2a-8fe8-4d0e-95b3-9fa8262538ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:41.912650 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284a5b2a-8fe8-4d0e-95b3-9fa8262538ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:41.913085 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284a5b2a-8fe8-4d0e-95b3-9fa8262538ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:41.913778 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284a5b2a-8fe8-4d0e-95b3-9fa8262538ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:41.914231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284a5b2a-8fe8-4d0e-95b3-9fa8262538ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:41.914655 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284a5b2a-8fe8-4d0e-95b3-9fa8262538ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:41.981554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-284a5b2a-8fe8-4d0e-95b3-9fa8262538ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:41.982078 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0cc6ed9-b1c2-43f9-8484-61f9287064d8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:41.982695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0cc6ed9-b1c2-43f9-8484-61f9287064d8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:41.989869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0cc6ed9-b1c2-43f9-8484-61f9287064d8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:41.990355 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0cc6ed9-b1c2-43f9-8484-61f9287064d8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:41.990793 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0cc6ed9-b1c2-43f9-8484-61f9287064d8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:41.991553 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0cc6ed9-b1c2-43f9-8484-61f9287064d8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:41.991849 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-284a5b2a-8fe8-4d0e-95b3-9fa8262538ae tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1330 microversion: 2.1 time: 0.091408 Oct 06 11:11:41.992033 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0cc6ed9-b1c2-43f9-8484-61f9287064d8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:41.992455 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0cc6ed9-b1c2-43f9-8484-61f9287064d8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:41.992568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 405/797] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:41 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1330 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:42.236529 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0cc6ed9-b1c2-43f9-8484-61f9287064d8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:42.244405 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0cc6ed9-b1c2-43f9-8484-61f9287064d8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.266185 Oct 06 11:11:42.245014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 393/798] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:41 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:42.404879 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b240f25-61ef-417c-ae30-217944f44a2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:42.406188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b240f25-61ef-417c-ae30-217944f44a2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:42.423879 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b240f25-61ef-417c-ae30-217944f44a2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:42.424781 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b240f25-61ef-417c-ae30-217944f44a2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:42.424903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b240f25-61ef-417c-ae30-217944f44a2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:42.425819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b240f25-61ef-417c-ae30-217944f44a2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:42.426440 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b240f25-61ef-417c-ae30-217944f44a2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:42.426875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b240f25-61ef-417c-ae30-217944f44a2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:42.561125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b240f25-61ef-417c-ae30-217944f44a2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:42.569681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b240f25-61ef-417c-ae30-217944f44a2c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1671 microversion: 2.1 time: 0.168558 Oct 06 11:11:42.570264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 406/799] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:42 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:42.731700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-cb62cb9b-6129-4fa8-90e8-338c0328a1e3 req-1b2cbef5-7a87-4c06-bab0-bb70d08c80aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc20029-503a-4c89-b422-088e3676b9c4", "tag": "94650b61-76aa-4105-9fd3-7f1db6829887"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:42.742162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cb62cb9b-6129-4fa8-90e8-338c0328a1e3 req-1b2cbef5-7a87-4c06-bab0-bb70d08c80aa service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:42.742754 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cb62cb9b-6129-4fa8-90e8-338c0328a1e3 req-1b2cbef5-7a87-4c06-bab0-bb70d08c80aa service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:42.743189 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cb62cb9b-6129-4fa8-90e8-338c0328a1e3 req-1b2cbef5-7a87-4c06-bab0-bb70d08c80aa service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:42.754583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-cb62cb9b-6129-4fa8-90e8-338c0328a1e3 req-1b2cbef5-7a87-4c06-bab0-bb70d08c80aa service nova] Creating event network-changed:94650b61-76aa-4105-9fd3-7f1db6829887 for instance 5fc20029-503a-4c89-b422-088e3676b9c4 on hv-cinder-86020 Oct 06 11:11:42.759512 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-cb62cb9b-6129-4fa8-90e8-338c0328a1e3 req-1b2cbef5-7a87-4c06-bab0-bb70d08c80aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103831 Oct 06 11:11:42.760129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 394/800] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:11:43.019277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:43.020662 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:43.028269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:43.029090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:43.029596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:43.031200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:43.031922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:43.032420 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:43.066012 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:43.066813 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:43.067252 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:43.067702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lazy-loading 'fault' on Instance uuid c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:11:43.118101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:43.125838 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f68fb04f-8576-4fbb-a374-1db5bf375475 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 200 len: 1335 microversion: 2.1 time: 0.111091 Oct 06 11:11:43.127098 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 407/801] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:43 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:43.267650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1be4044d-e535-4a69-9466-c5828a7acf9e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:43.269026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1be4044d-e535-4a69-9466-c5828a7acf9e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:43.276581 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1be4044d-e535-4a69-9466-c5828a7acf9e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:43.277073 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1be4044d-e535-4a69-9466-c5828a7acf9e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:43.277514 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1be4044d-e535-4a69-9466-c5828a7acf9e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:43.278218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1be4044d-e535-4a69-9466-c5828a7acf9e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:43.278674 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1be4044d-e535-4a69-9466-c5828a7acf9e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:43.279096 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1be4044d-e535-4a69-9466-c5828a7acf9e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:43.595545 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c411746-b4d4-480c-81d0-695dc4884cd1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:43.596436 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c411746-b4d4-480c-81d0-695dc4884cd1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:43.603298 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c411746-b4d4-480c-81d0-695dc4884cd1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:43.604544 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c411746-b4d4-480c-81d0-695dc4884cd1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:43.604991 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c411746-b4d4-480c-81d0-695dc4884cd1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:43.605881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c411746-b4d4-480c-81d0-695dc4884cd1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:43.606712 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c411746-b4d4-480c-81d0-695dc4884cd1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:43.607157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c411746-b4d4-480c-81d0-695dc4884cd1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:43.685160 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1be4044d-e535-4a69-9466-c5828a7acf9e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:43.690514 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c411746-b4d4-480c-81d0-695dc4884cd1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:43.693615 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1be4044d-e535-4a69-9466-c5828a7acf9e tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.430737 Oct 06 11:11:43.694341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 395/802] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:43 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:43.714792 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c411746-b4d4-480c-81d0-695dc4884cd1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1603 microversion: 2.1 time: 0.124608 Oct 06 11:11:43.715636 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 408/803] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:43 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1603 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:43.805307 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-81173c3f-74f4-49e1-b72b-16c5f81ce8fc req-166faf2e-14e4-4c1c-a99e-a4683985432e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb86039-b159-435a-b022-4396a59b657c", "name": "network-vif-deleted", "tag": "f595a1a4-6f82-46d6-9c95-1fd836a18532"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:43.815179 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-81173c3f-74f4-49e1-b72b-16c5f81ce8fc req-166faf2e-14e4-4c1c-a99e-a4683985432e service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:43.815771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-81173c3f-74f4-49e1-b72b-16c5f81ce8fc req-166faf2e-14e4-4c1c-a99e-a4683985432e service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:43.816228 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-81173c3f-74f4-49e1-b72b-16c5f81ce8fc req-166faf2e-14e4-4c1c-a99e-a4683985432e service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:43.827388 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-81173c3f-74f4-49e1-b72b-16c5f81ce8fc req-166faf2e-14e4-4c1c-a99e-a4683985432e service nova] Creating event network-vif-deleted:f595a1a4-6f82-46d6-9c95-1fd836a18532 for instance 3eb86039-b159-435a-b022-4396a59b657c on hv-cinder-86020 Oct 06 11:11:43.832638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-81173c3f-74f4-49e1-b72b-16c5f81ce8fc req-166faf2e-14e4-4c1c-a99e-a4683985432e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031047 Oct 06 11:11:43.833650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 396/804] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:44.150693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:44.151560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:44.158597 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:44.159090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:44.159598 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:44.160330 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:44.160781 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:44.161202 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:44.175629 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] HTTP exception thrown: Instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a could not be found. Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Request method failure captured: Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a HTTP/1.1 Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrYu0enH4vmsKaJVbdYN_HXF96VpdOfcnSPVjuOyC1wHfnVf-P5CdJP_RhW1d5ghD_rC7x0bdbKgaYHfMIElHsj8h1NA1rTfAWXvAIerZh8U8vsnNP1tXgQcEtSqpkhXEfWvyuSjFOkqhXel7QtylouArs23P4CdP8S_7KApeM7ViKk Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 4ebb258de32f40c68f86e4b401efde5d Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:11:44.177349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 4ebb258de32f40c68f86e4b401efde5d Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-1763361212-project Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: f1815cf2b3f347eb8276769cc30cf116 Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1763361212-project Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a could not be found. Oct 06 11:11:44.179020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': 'c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a'} Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a could not be found. Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:11:44.179955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a could not be found. Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a could not be found. Oct 06 11:11:44.181274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:11:44.182438 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Returning 404 to user: Instance c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:11:44.182438 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efe58d7c-fbdf-471d-a07d-2c59163c79df tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a" status: 404 len: 111 microversion: 2.1 time: 0.032453 Oct 06 11:11:44.182438 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 409/805] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:44 2022] GET /compute/v2.1/servers/c0ff9abe-36ad-4560-93ae-cd7ec9f0d46a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:11:44.189124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-14eac38f-957e-4bc4-9299-144501fc907e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '.version_select at 0x7f92a6cc4820>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:44.210109 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-14eac38f-957e-4bc4-9299-144501fc907e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355366370" status: 202 len: 0 microversion: 2.1 time: 0.025288 Oct 06 11:11:44.210706 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 397/806] 10.222.0.52 () {58 vars in 1221 bytes} [Thu Oct 6 11:11:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355366370 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:11:44.717265 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-20bdfd5d-f62f-4892-bc27-e9f540a330f1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:44.718403 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-20bdfd5d-f62f-4892-bc27-e9f540a330f1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:44.724955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20bdfd5d-f62f-4892-bc27-e9f540a330f1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:44.725454 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20bdfd5d-f62f-4892-bc27-e9f540a330f1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:44.725926 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20bdfd5d-f62f-4892-bc27-e9f540a330f1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:44.726608 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20bdfd5d-f62f-4892-bc27-e9f540a330f1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:44.727078 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20bdfd5d-f62f-4892-bc27-e9f540a330f1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:44.727505 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20bdfd5d-f62f-4892-bc27-e9f540a330f1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:44.739975 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7d8079f-1d98-40c8-a6ea-c347da7f8967 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:44.740949 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7d8079f-1d98-40c8-a6ea-c347da7f8967 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:44.752486 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d8079f-1d98-40c8-a6ea-c347da7f8967 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:44.752983 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d8079f-1d98-40c8-a6ea-c347da7f8967 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:44.753415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d8079f-1d98-40c8-a6ea-c347da7f8967 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:44.755041 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d8079f-1d98-40c8-a6ea-c347da7f8967 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:44.755564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d8079f-1d98-40c8-a6ea-c347da7f8967 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:44.756405 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d8079f-1d98-40c8-a6ea-c347da7f8967 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:44.821029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7d8079f-1d98-40c8-a6ea-c347da7f8967 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:44.829041 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7d8079f-1d98-40c8-a6ea-c347da7f8967 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1603 microversion: 2.1 time: 0.093621 Oct 06 11:11:44.829610 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 398/807] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:44 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1603 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:45.205770 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-20bdfd5d-f62f-4892-bc27-e9f540a330f1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:45.213357 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-20bdfd5d-f62f-4892-bc27-e9f540a330f1 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.499959 Oct 06 11:11:45.213918 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 410/808] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:44 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:45.852508 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cfd3a097-6ec4-4054-baa0-8739ef63a625 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:45.853125 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cfd3a097-6ec4-4054-baa0-8739ef63a625 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:45.860470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd3a097-6ec4-4054-baa0-8739ef63a625 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:45.860961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd3a097-6ec4-4054-baa0-8739ef63a625 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:45.861407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd3a097-6ec4-4054-baa0-8739ef63a625 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:45.862102 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd3a097-6ec4-4054-baa0-8739ef63a625 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:45.862565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd3a097-6ec4-4054-baa0-8739ef63a625 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:45.862992 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd3a097-6ec4-4054-baa0-8739ef63a625 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:45.923998 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cfd3a097-6ec4-4054-baa0-8739ef63a625 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:45.931651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cfd3a097-6ec4-4054-baa0-8739ef63a625 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 200 len: 1603 microversion: 2.1 time: 0.083082 Oct 06 11:11:45.932256 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 399/809] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:45 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 1603 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:46.237140 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb5245d0-3b90-4d72-9808-9363fd801c4a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:46.237846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb5245d0-3b90-4d72-9808-9363fd801c4a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:46.244912 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5245d0-3b90-4d72-9808-9363fd801c4a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:46.245678 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5245d0-3b90-4d72-9808-9363fd801c4a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:46.246314 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5245d0-3b90-4d72-9808-9363fd801c4a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:46.247090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5245d0-3b90-4d72-9808-9363fd801c4a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:46.247627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5245d0-3b90-4d72-9808-9363fd801c4a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:46.248141 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb5245d0-3b90-4d72-9808-9363fd801c4a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:46.420593 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb5245d0-3b90-4d72-9808-9363fd801c4a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:46.428510 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb5245d0-3b90-4d72-9808-9363fd801c4a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.196789 Oct 06 11:11:46.429182 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 411/810] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:46 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:46.954574 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:46.955184 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:46.961701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:46.962171 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:46.962606 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:46.963301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:46.963752 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:46.964198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:46.979074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] HTTP exception thrown: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Request method failure captured: Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c HTTP/1.1 Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYr9286ddhT2GiULSW1xDw111Fh_IAZttVLQN30Bz8q-VQOpjfXyvDUqHu3s_WG0Cj_WPQ2HB7DRQIl5KNc0jHz6Sop9Fgb4nwQSwBDZceh849x5wxvbEmG-Zy39b-hfwWjuyXoOmZCgQ8yI5wd1ttREzJrHmHTOkcwH5RNpBddppI Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:11:46.980843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 1bb1115590ac45fdbcdc6d3f52aa6921 Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:11:46.982500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '3eb86039-b159-435a-b022-4396a59b657c'} Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:11:46.983315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:11:46.985339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:11:46.986721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Returning 404 to user: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:11:46.986721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bbca2946-78b9-4808-83a6-3521dfd4d2fa tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 404 len: 111 microversion: 2.1 time: 0.031556 Oct 06 11:11:46.986721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 400/811] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:46 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:11:46.992230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ad56ac4-3938-4759-b6fa-2a869b7b1b4c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '.version_select at 0x7f92a6f3eca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:47.011093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ad56ac4-3938-4759-b6fa-2a869b7b1b4c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-462469057" status: 202 len: 0 microversion: 2.1 time: 0.022617 Oct 06 11:11:47.011775 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 412/812] 10.222.0.52 () {58 vars in 1218 bytes} [Thu Oct 6 11:11:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-462469057 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:11:47.193051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08999859-9dd7-469a-b754-5324cd102138 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:47.193651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08999859-9dd7-469a-b754-5324cd102138 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:47.199710 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08999859-9dd7-469a-b754-5324cd102138 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:47.200291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08999859-9dd7-469a-b754-5324cd102138 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:47.200789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08999859-9dd7-469a-b754-5324cd102138 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:47.201536 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08999859-9dd7-469a-b754-5324cd102138 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:47.202079 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08999859-9dd7-469a-b754-5324cd102138 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:47.203073 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08999859-9dd7-469a-b754-5324cd102138 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:47.234117 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08999859-9dd7-469a-b754-5324cd102138 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:11:47.312555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08999859-9dd7-469a-b754-5324cd102138 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 204 len: 0 microversion: 2.1 time: 0.122987 Oct 06 11:11:47.316450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 401/813] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:11:47 2022] DELETE /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:11:47.322122 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-541266f6-2e9a-42e0-ad37-a47bf14bb435 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:47.322741 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-541266f6-2e9a-42e0-ad37-a47bf14bb435 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:47.329602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541266f6-2e9a-42e0-ad37-a47bf14bb435 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:47.330100 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541266f6-2e9a-42e0-ad37-a47bf14bb435 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:47.330548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541266f6-2e9a-42e0-ad37-a47bf14bb435 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:47.331257 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541266f6-2e9a-42e0-ad37-a47bf14bb435 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:47.331722 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541266f6-2e9a-42e0-ad37-a47bf14bb435 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:47.332189 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541266f6-2e9a-42e0-ad37-a47bf14bb435 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:47.454311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94ad227e-6b59-4fae-9a1c-e8e116d21854 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:47.455330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94ad227e-6b59-4fae-9a1c-e8e116d21854 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:47.461750 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ad227e-6b59-4fae-9a1c-e8e116d21854 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:47.462248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ad227e-6b59-4fae-9a1c-e8e116d21854 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:47.462687 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ad227e-6b59-4fae-9a1c-e8e116d21854 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:47.463395 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ad227e-6b59-4fae-9a1c-e8e116d21854 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:47.463875 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ad227e-6b59-4fae-9a1c-e8e116d21854 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:47.464291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ad227e-6b59-4fae-9a1c-e8e116d21854 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:47.489410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-541266f6-2e9a-42e0-ad37-a47bf14bb435 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:47.497350 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-541266f6-2e9a-42e0-ad37-a47bf14bb435 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1508 microversion: 2.1 time: 0.179472 Oct 06 11:11:47.512223 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 413/814] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:47 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:47.697910 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-94ad227e-6b59-4fae-9a1c-e8e116d21854 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:47.707146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94ad227e-6b59-4fae-9a1c-e8e116d21854 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.258212 Oct 06 11:11:47.707808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 402/815] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:47 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:47.746313 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-725b393a-6bf9-4b51-9988-cc2158d4e532 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'create', calling method: .version_select at 0x7f92a6d96820>, body: {"keypair": {"name": "tempest-keypair-695847567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwEDHbmKn42zxHnkPFeFaymcp9Jg2gLgYYBMwIiav2SciChrz+j4huW4p7xdN17gap+VNHA2rTxo4RUdHehv7c/V3rAaJZUQQoSrCx1p4hAppiQ1WauErnl/Zx0Mk3prA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:47.762065 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-725b393a-6bf9-4b51-9988-cc2158d4e532 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Getting quotas for project 8c9bfd4947d045cf831f1a60bf91f389. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:11:47.765860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-725b393a-6bf9-4b51-9988-cc2158d4e532 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Getting quotas for user 1bb1115590ac45fdbcdc6d3f52aa6921 and project 8c9bfd4947d045cf831f1a60bf91f389. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:11:47.774881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:47.787945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-725b393a-6bf9-4b51-9988-cc2158d4e532 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045457 Oct 06 11:11:47.788538 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 414/816] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Oct 6 11:11:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:48.521842 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc90e6f3-73e9-4ea1-bae9-cc2655c5833e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:48.522781 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc90e6f3-73e9-4ea1-bae9-cc2655c5833e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:48.529122 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc90e6f3-73e9-4ea1-bae9-cc2655c5833e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:48.529619 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc90e6f3-73e9-4ea1-bae9-cc2655c5833e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:48.530092 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc90e6f3-73e9-4ea1-bae9-cc2655c5833e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:48.531535 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc90e6f3-73e9-4ea1-bae9-cc2655c5833e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:48.532148 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc90e6f3-73e9-4ea1-bae9-cc2655c5833e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:48.532587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc90e6f3-73e9-4ea1-bae9-cc2655c5833e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:48.663454 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-dc90e6f3-73e9-4ea1-bae9-cc2655c5833e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:48.671875 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc90e6f3-73e9-4ea1-bae9-cc2655c5833e tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1508 microversion: 2.1 time: 0.153850 Oct 06 11:11:48.673029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 403/817] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:48 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:48.731398 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72619ce9-061a-403b-8c2a-fa040a4da6c0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:48.731938 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-72619ce9-061a-403b-8c2a-fa040a4da6c0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:48.740633 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72619ce9-061a-403b-8c2a-fa040a4da6c0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:48.741118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72619ce9-061a-403b-8c2a-fa040a4da6c0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:48.741769 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72619ce9-061a-403b-8c2a-fa040a4da6c0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:48.742635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72619ce9-061a-403b-8c2a-fa040a4da6c0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:48.743241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72619ce9-061a-403b-8c2a-fa040a4da6c0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:48.743828 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72619ce9-061a-403b-8c2a-fa040a4da6c0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:48.836811 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-39bacae4-9ea8-4997-96b6-da8bc9d84dff req-93eb1336-1045-4272-a131-234ec2892d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc20029-503a-4c89-b422-088e3676b9c4", "name": "network-vif-plugged", "status": "completed", "tag": "94650b61-76aa-4105-9fd3-7f1db6829887"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:48.850787 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-39bacae4-9ea8-4997-96b6-da8bc9d84dff req-93eb1336-1045-4272-a131-234ec2892d3b service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:48.851490 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-39bacae4-9ea8-4997-96b6-da8bc9d84dff req-93eb1336-1045-4272-a131-234ec2892d3b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:48.851986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-39bacae4-9ea8-4997-96b6-da8bc9d84dff req-93eb1336-1045-4272-a131-234ec2892d3b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:48.865460 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-39bacae4-9ea8-4997-96b6-da8bc9d84dff req-93eb1336-1045-4272-a131-234ec2892d3b service nova] Creating event network-vif-plugged:94650b61-76aa-4105-9fd3-7f1db6829887 for instance 5fc20029-503a-4c89-b422-088e3676b9c4 on hv-cinder-86020 Oct 06 11:11:48.870631 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-39bacae4-9ea8-4997-96b6-da8bc9d84dff req-93eb1336-1045-4272-a131-234ec2892d3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037487 Oct 06 11:11:48.871480 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 404/818] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:11:49.039377 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-72619ce9-061a-403b-8c2a-fa040a4da6c0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:49.041977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:49.049807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72619ce9-061a-403b-8c2a-fa040a4da6c0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.323747 Oct 06 11:11:49.050700 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 415/819] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:48 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:49.200237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1644b799-91bc-4875-8c41-5cc297507bb9 req-0e5a0ec6-db38-4e94-9cd4-a3b64f48fe51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9864b6-cb13-4dc0-97d2-e155a1717ec9", "name": "network-vif-deleted", "tag": "50343d2f-ca78-433a-93c4-aaa96d6e2a26"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:49.210504 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1644b799-91bc-4875-8c41-5cc297507bb9 req-0e5a0ec6-db38-4e94-9cd4-a3b64f48fe51 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:49.211028 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1644b799-91bc-4875-8c41-5cc297507bb9 req-0e5a0ec6-db38-4e94-9cd4-a3b64f48fe51 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:49.211454 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1644b799-91bc-4875-8c41-5cc297507bb9 req-0e5a0ec6-db38-4e94-9cd4-a3b64f48fe51 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:49.223319 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1644b799-91bc-4875-8c41-5cc297507bb9 req-0e5a0ec6-db38-4e94-9cd4-a3b64f48fe51 service nova] Creating event network-vif-deleted:50343d2f-ca78-433a-93c4-aaa96d6e2a26 for instance ec9864b6-cb13-4dc0-97d2-e155a1717ec9 on hv-cinder-86020 Oct 06 11:11:49.228567 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1644b799-91bc-4875-8c41-5cc297507bb9 req-0e5a0ec6-db38-4e94-9cd4-a3b64f48fe51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032634 Oct 06 11:11:49.229645 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 405/820] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:49.593851 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1712284668", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fea6c97c-9c48-403d-929b-bfa5008b2a1f"}], "security_groups": [{"name": "tempest-securitygroup--1470723539"}], "key_name": "tempest-keypair-695847567", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:49.696880 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:49.698697 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:49.705763 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:49.706442 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:49.707124 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] validate_networks() for [('fea6c97c-9c48-403d-929b-bfa5008b2a1f', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:11:49.707368 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:49.708207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:49.708714 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:49.709082 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:49.725837 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:49.739381 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:49.744229 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:49.744716 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:49.745138 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:49.745586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lazy-loading 'fault' on Instance uuid ec9864b6-cb13-4dc0-97d2-e155a1717ec9 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:11:49.790406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:49.799036 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18eeba64-588c-41df-8e2e-df3d7ab66d95 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1311 microversion: 2.1 time: 0.107481 Oct 06 11:11:49.799621 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 406/821] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:49 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:50.073521 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a673a3ae-77b9-4c37-8b89-3f99f15bf110 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:50.074147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a673a3ae-77b9-4c37-8b89-3f99f15bf110 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:50.081029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a673a3ae-77b9-4c37-8b89-3f99f15bf110 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:50.081521 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a673a3ae-77b9-4c37-8b89-3f99f15bf110 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:50.081959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a673a3ae-77b9-4c37-8b89-3f99f15bf110 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:50.082657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a673a3ae-77b9-4c37-8b89-3f99f15bf110 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:50.083111 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a673a3ae-77b9-4c37-8b89-3f99f15bf110 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:50.083536 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a673a3ae-77b9-4c37-8b89-3f99f15bf110 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:50.094786 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:11:50.095333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:11:50.095806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:11:50.096362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:11:50.096781 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:11:50.105822 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:50.106307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:50.106741 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:50.107467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:50.107954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:50.108398 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:50.124701 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Getting quotas for project 8c9bfd4947d045cf831f1a60bf91f389. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:11:50.129151 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Getting quotas for user 1bb1115590ac45fdbcdc6d3f52aa6921 and project 8c9bfd4947d045cf831f1a60bf91f389. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:11:50.140666 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:11:50.143055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:11:50.198615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-76497b0e-8268-425d-8bca-5f9bd7391abb tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.611245 Oct 06 11:11:50.199502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 416/822] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:11:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:11:50.212795 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8a15502-347b-41e8-b220-30df29b953c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:50.213424 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8a15502-347b-41e8-b220-30df29b953c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:50.228517 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a673a3ae-77b9-4c37-8b89-3f99f15bf110 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:50.236768 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a673a3ae-77b9-4c37-8b89-3f99f15bf110 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1356 microversion: 2.1 time: 0.167097 Oct 06 11:11:50.237338 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 407/823] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:50 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:50.274049 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8a15502-347b-41e8-b220-30df29b953c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:50.282805 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8a15502-347b-41e8-b220-30df29b953c6 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1237 microversion: 2.1 time: 0.074778 Oct 06 11:11:50.283878 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 417/824] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:50 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:50.821907 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:50.822517 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:50.831105 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:50.832126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:50.832126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:50.832854 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:50.833224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:50.833719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:50.874384 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:50.875055 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:50.875499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:50.876367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lazy-loading 'fault' on Instance uuid ec9864b6-cb13-4dc0-97d2-e155a1717ec9 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:11:50.919507 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:50.927314 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98ab16ce-bdfc-4da6-8fe9-6eadaaeef266 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 200 len: 1311 microversion: 2.1 time: 0.109215 Oct 06 11:11:50.927971 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 408/825] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:50 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:51.259228 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-935db583-d23e-404b-abb4-9316b108ff36 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:51.259858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-935db583-d23e-404b-abb4-9316b108ff36 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:51.267334 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935db583-d23e-404b-abb4-9316b108ff36 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.267821 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935db583-d23e-404b-abb4-9316b108ff36 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.268305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935db583-d23e-404b-abb4-9316b108ff36 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.269008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935db583-d23e-404b-abb4-9316b108ff36 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.269468 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935db583-d23e-404b-abb4-9316b108ff36 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.269895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935db583-d23e-404b-abb4-9316b108ff36 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.305765 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2553c370-3013-4862-8e7d-2722fc782129 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:51.306450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2553c370-3013-4862-8e7d-2722fc782129 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:51.313455 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2553c370-3013-4862-8e7d-2722fc782129 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.313947 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2553c370-3013-4862-8e7d-2722fc782129 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.314586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2553c370-3013-4862-8e7d-2722fc782129 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.317966 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2553c370-3013-4862-8e7d-2722fc782129 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.318677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2553c370-3013-4862-8e7d-2722fc782129 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.319123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2553c370-3013-4862-8e7d-2722fc782129 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.400891 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2553c370-3013-4862-8e7d-2722fc782129 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:51.411493 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2553c370-3013-4862-8e7d-2722fc782129 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1233 microversion: 2.1 time: 0.109534 Oct 06 11:11:51.412678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 409/826] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:51 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1233 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:51.431719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-935db583-d23e-404b-abb4-9316b108ff36 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:51.440434 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-935db583-d23e-404b-abb4-9316b108ff36 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1546 microversion: 2.1 time: 0.185045 Oct 06 11:11:51.441013 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 418/827] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:51 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:51.463498 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b892559f-4ed7-4096-9a03-f1d5b998ca4d tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:51.464167 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b892559f-4ed7-4096-9a03-f1d5b998ca4d tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:51.470824 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b892559f-4ed7-4096-9a03-f1d5b998ca4d tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.471343 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b892559f-4ed7-4096-9a03-f1d5b998ca4d tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.471867 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b892559f-4ed7-4096-9a03-f1d5b998ca4d tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.472660 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b892559f-4ed7-4096-9a03-f1d5b998ca4d tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.473800 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b892559f-4ed7-4096-9a03-f1d5b998ca4d tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.474234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b892559f-4ed7-4096-9a03-f1d5b998ca4d tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.608907 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b892559f-4ed7-4096-9a03-f1d5b998ca4d tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:51.616625 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b892559f-4ed7-4096-9a03-f1d5b998ca4d tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1546 microversion: 2.1 time: 0.156928 Oct 06 11:11:51.617177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 410/828] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:51 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:51.638693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:51.643745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:51.644552 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Searching by: {'deleted': False, 'project_id': 'ca311e63675241eaaef42a8154e905ac'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 11:11:51.651230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.651714 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.652193 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.652928 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.653391 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.653821 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.743613 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 11:11:51.834830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ca188ee-b5e3-4543-9d60-42e102b8c961 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.199679 Oct 06 11:11:51.835341 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 419/829] 10.222.0.52 () {58 vars in 1125 bytes} [Thu Oct 6 11:11:51 2022] GET /compute/v2.1/servers => generated 341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:51.847744 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-32b22029-a5a7-4adb-9815-b8f9b9fc5d7a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:51.848391 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-32b22029-a5a7-4adb-9815-b8f9b9fc5d7a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:51.854351 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32b22029-a5a7-4adb-9815-b8f9b9fc5d7a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.854833 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32b22029-a5a7-4adb-9815-b8f9b9fc5d7a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.855268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32b22029-a5a7-4adb-9815-b8f9b9fc5d7a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.855980 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32b22029-a5a7-4adb-9815-b8f9b9fc5d7a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.856438 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32b22029-a5a7-4adb-9815-b8f9b9fc5d7a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.856861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32b22029-a5a7-4adb-9815-b8f9b9fc5d7a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.951475 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:51.952898 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: ec9864b6-cb13-4dc0-97d2-e155a1717ec9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:51.969286 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.969899 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.970254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.971048 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:51.971424 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:51.972080 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:51.988240 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] HTTP exception thrown: Instance ec9864b6-cb13-4dc0-97d2-e155a1717ec9 could not be found. Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Request method failure captured: Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 HTTP/1.1 Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrYu0enH4vmsKaJVbdYN_HXF96VpdOfcnSPVjuOyC1wHfnVf-P5CdJP_RhW1d5ghD_rC7x0bdbKgaYHfMIElHsj8h1NA1rTfAWXvAIerZh8U8vsnNP1tXgQcEtSqpkhXEfWvyuSjFOkqhXel7QtylouArs23P4CdP8S_7KApeM7ViKk Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 4ebb258de32f40c68f86e4b401efde5d Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:11:51.990165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 4ebb258de32f40c68f86e4b401efde5d Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-1763361212-project Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: f1815cf2b3f347eb8276769cc30cf116 Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1763361212-project Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance ec9864b6-cb13-4dc0-97d2-e155a1717ec9 could not be found. Oct 06 11:11:51.991687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': 'ec9864b6-cb13-4dc0-97d2-e155a1717ec9'} Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9864b6-cb13-4dc0-97d2-e155a1717ec9 could not be found. Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:11:51.992657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9864b6-cb13-4dc0-97d2-e155a1717ec9 could not be found. Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9864b6-cb13-4dc0-97d2-e155a1717ec9 could not be found. Oct 06 11:11:51.993893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:11:52.001179 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Returning 404 to user: Instance ec9864b6-cb13-4dc0-97d2-e155a1717ec9 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:11:52.002658 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59022dbe-7c96-4ad6-acff-2578389e3931 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9" status: 404 len: 111 microversion: 2.1 time: 0.055794 Oct 06 11:11:52.003886 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 420/830] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:51 2022] GET /compute/v2.1/servers/ec9864b6-cb13-4dc0-97d2-e155a1717ec9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 11:11:52.004075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-32b22029-a5a7-4adb-9815-b8f9b9fc5d7a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:52.012225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-171cd53b-38b4-479e-8095-07a3b88681db tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:52.012890 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-171cd53b-38b4-479e-8095-07a3b88681db tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:52.019579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-171cd53b-38b4-479e-8095-07a3b88681db tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:52.020104 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-171cd53b-38b4-479e-8095-07a3b88681db tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:52.020274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-32b22029-a5a7-4adb-9815-b8f9b9fc5d7a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1546 microversion: 2.1 time: 0.177275 Oct 06 11:11:52.020546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-171cd53b-38b4-479e-8095-07a3b88681db tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:52.021263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 411/831] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:51 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:52.021381 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-171cd53b-38b4-479e-8095-07a3b88681db tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:52.021725 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-171cd53b-38b4-479e-8095-07a3b88681db tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:52.022405 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-171cd53b-38b4-479e-8095-07a3b88681db tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:52.063201 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-171cd53b-38b4-479e-8095-07a3b88681db tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:11:52.159024 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-171cd53b-38b4-479e-8095-07a3b88681db tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "DELETE /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 204 len: 0 microversion: 2.1 time: 0.150219 Oct 06 11:11:52.160959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 421/832] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:11:52 2022] DELETE /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 11:11:52.170441 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d74c3d6f-5d06-4a69-9ad8-44ffb65c6697 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:52.171519 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d74c3d6f-5d06-4a69-9ad8-44ffb65c6697 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:52.181618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d74c3d6f-5d06-4a69-9ad8-44ffb65c6697 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:52.182119 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d74c3d6f-5d06-4a69-9ad8-44ffb65c6697 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:52.182691 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d74c3d6f-5d06-4a69-9ad8-44ffb65c6697 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:52.183346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d74c3d6f-5d06-4a69-9ad8-44ffb65c6697 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:52.183885 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d74c3d6f-5d06-4a69-9ad8-44ffb65c6697 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:52.184592 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d74c3d6f-5d06-4a69-9ad8-44ffb65c6697 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:52.330092 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d74c3d6f-5d06-4a69-9ad8-44ffb65c6697 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:52.337620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d74c3d6f-5d06-4a69-9ad8-44ffb65c6697 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.172784 Oct 06 11:11:52.338407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 412/833] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:52 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:52.435075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebee98a3-c000-4ab5-a3df-7a2f9e389850 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:52.435788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebee98a3-c000-4ab5-a3df-7a2f9e389850 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:52.442717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebee98a3-c000-4ab5-a3df-7a2f9e389850 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:52.443214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebee98a3-c000-4ab5-a3df-7a2f9e389850 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:52.443759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebee98a3-c000-4ab5-a3df-7a2f9e389850 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:52.444492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebee98a3-c000-4ab5-a3df-7a2f9e389850 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:52.445121 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebee98a3-c000-4ab5-a3df-7a2f9e389850 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:52.445617 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebee98a3-c000-4ab5-a3df-7a2f9e389850 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:52.510554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebee98a3-c000-4ab5-a3df-7a2f9e389850 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:52.518819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebee98a3-c000-4ab5-a3df-7a2f9e389850 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1295 microversion: 2.1 time: 0.087982 Oct 06 11:11:52.519387 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 422/834] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:52 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1295 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:53.361673 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c7ae978-12e1-4350-b407-69ef0fff9906 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:53.362226 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6c7ae978-12e1-4350-b407-69ef0fff9906 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:53.368613 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7ae978-12e1-4350-b407-69ef0fff9906 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:53.369096 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7ae978-12e1-4350-b407-69ef0fff9906 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:53.369564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7ae978-12e1-4350-b407-69ef0fff9906 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:53.370248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7ae978-12e1-4350-b407-69ef0fff9906 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:53.370700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7ae978-12e1-4350-b407-69ef0fff9906 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:53.371121 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7ae978-12e1-4350-b407-69ef0fff9906 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:53.543377 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9aceb95-1688-442d-a7bc-ecbd4d8e6520 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:53.544000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9aceb95-1688-442d-a7bc-ecbd4d8e6520 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:53.551116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9aceb95-1688-442d-a7bc-ecbd4d8e6520 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:53.551608 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9aceb95-1688-442d-a7bc-ecbd4d8e6520 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:53.552148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9aceb95-1688-442d-a7bc-ecbd4d8e6520 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:53.552853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9aceb95-1688-442d-a7bc-ecbd4d8e6520 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:53.553311 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9aceb95-1688-442d-a7bc-ecbd4d8e6520 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:53.553732 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9aceb95-1688-442d-a7bc-ecbd4d8e6520 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:53.614841 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c7ae978-12e1-4350-b407-69ef0fff9906 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:53.623435 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c7ae978-12e1-4350-b407-69ef0fff9906 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1522 microversion: 2.1 time: 0.266625 Oct 06 11:11:53.636122 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 413/835] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:53 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:53.771654 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9aceb95-1688-442d-a7bc-ecbd4d8e6520 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:53.781478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9aceb95-1688-442d-a7bc-ecbd4d8e6520 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1363 microversion: 2.1 time: 0.241651 Oct 06 11:11:53.782396 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 423/836] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:53 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:53.978992 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ee833178-a24b-4e24-a8ff-eb1f21d45ef8 req-8279576a-c34f-47cc-a86f-dba0b8418df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41685b83-a75b-4abc-814c-c9a4424f2c65", "name": "network-vif-deleted", "tag": "5a60437f-d87b-4705-ab02-ee352497d7bb"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:53.989719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ee833178-a24b-4e24-a8ff-eb1f21d45ef8 req-8279576a-c34f-47cc-a86f-dba0b8418df1 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:53.990529 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ee833178-a24b-4e24-a8ff-eb1f21d45ef8 req-8279576a-c34f-47cc-a86f-dba0b8418df1 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:53.991180 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ee833178-a24b-4e24-a8ff-eb1f21d45ef8 req-8279576a-c34f-47cc-a86f-dba0b8418df1 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:54.003482 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ee833178-a24b-4e24-a8ff-eb1f21d45ef8 req-8279576a-c34f-47cc-a86f-dba0b8418df1 service nova] Creating event network-vif-deleted:5a60437f-d87b-4705-ab02-ee352497d7bb for instance 41685b83-a75b-4abc-814c-c9a4424f2c65 on hv-cinder-86020 Oct 06 11:11:54.009035 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ee833178-a24b-4e24-a8ff-eb1f21d45ef8 req-8279576a-c34f-47cc-a86f-dba0b8418df1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038385 Oct 06 11:11:54.009717 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 414/837] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:54.174967 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-962afa74-c622-48c3-b9ec-f029bd004c9b req-4d3647bc-d51c-487e-affe-ed9e7e043e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562fb9bc-717f-4fea-9e1d-3b3637138ca8", "tag": "a1ce9ffa-2969-4b3f-8579-49451048adf4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:54.184574 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-962afa74-c622-48c3-b9ec-f029bd004c9b req-4d3647bc-d51c-487e-affe-ed9e7e043e06 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:54.185112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-962afa74-c622-48c3-b9ec-f029bd004c9b req-4d3647bc-d51c-487e-affe-ed9e7e043e06 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:54.185539 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-962afa74-c622-48c3-b9ec-f029bd004c9b req-4d3647bc-d51c-487e-affe-ed9e7e043e06 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:54.197610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-962afa74-c622-48c3-b9ec-f029bd004c9b req-4d3647bc-d51c-487e-affe-ed9e7e043e06 service nova] Creating event network-changed:a1ce9ffa-2969-4b3f-8579-49451048adf4 for instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 on hv-cinder-86020 Oct 06 11:11:54.203209 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-962afa74-c622-48c3-b9ec-f029bd004c9b req-4d3647bc-d51c-487e-affe-ed9e7e043e06 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031223 Oct 06 11:11:54.204368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 424/838] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:54.652058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:54.652776 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:54.662426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:54.663287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:54.663934 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:54.665133 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:54.665734 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:54.666969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:54.684628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1e84b363-115d-4873-9f36-7f5d9d3a4766 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a67990e6-2c1d-4af2-aab6-f2f8c22a0983"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:11:54.689504 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1e84b363-115d-4873-9f36-7f5d9d3a4766 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:54.697496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e84b363-115d-4873-9f36-7f5d9d3a4766 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:54.697920 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e84b363-115d-4873-9f36-7f5d9d3a4766 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:54.698358 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e84b363-115d-4873-9f36-7f5d9d3a4766 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:54.699062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e84b363-115d-4873-9f36-7f5d9d3a4766 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:54.699685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e84b363-115d-4873-9f36-7f5d9d3a4766 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:54.700411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e84b363-115d-4873-9f36-7f5d9d3a4766 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:54.716868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:54.718369 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:54.719134 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:54.719590 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lazy-loading 'fault' on Instance uuid 41685b83-a75b-4abc-814c-c9a4424f2c65 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:11:54.769267 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1815cf2b3f347eb8276769cc30cf116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebb258de32f40c68f86e4b401efde5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:54.776640 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-051182b9-a849-4520-a6ba-8a7d7a8298c7 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 200 len: 1312 microversion: 2.1 time: 0.133587 Oct 06 11:11:54.777218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 415/839] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:54 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:54.804794 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c743738-f9bf-469a-817b-189640e106cd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:54.805414 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c743738-f9bf-469a-817b-189640e106cd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:54.811247 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c743738-f9bf-469a-817b-189640e106cd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:54.811944 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c743738-f9bf-469a-817b-189640e106cd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:54.812603 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c743738-f9bf-469a-817b-189640e106cd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:54.813304 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c743738-f9bf-469a-817b-189640e106cd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:54.813764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c743738-f9bf-469a-817b-189640e106cd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:54.814195 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c743738-f9bf-469a-817b-189640e106cd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:54.965336 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c743738-f9bf-469a-817b-189640e106cd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:54.973768 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c743738-f9bf-469a-817b-189640e106cd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1363 microversion: 2.1 time: 0.172774 Oct 06 11:11:54.974397 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 416/840] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:54 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:11:54.991942 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1e84b363-115d-4873-9f36-7f5d9d3a4766 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "POST /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315166 Oct 06 11:11:54.992557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 425/841] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:11:54 2022] POST /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:11:55.801007 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:55.801659 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] [instance: 41685b83-a75b-4abc-814c-c9a4424f2c65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:55.808101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:55.808589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:55.809026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:55.809724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:55.810177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:55.810602 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:55.824724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] HTTP exception thrown: Instance 41685b83-a75b-4abc-814c-c9a4424f2c65 could not be found. Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Request method failure captured: Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 HTTP/1.1 Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYu0enH4vmsKaJVbdYN_HXF96VpdOfcnSPVjuOyC1wHfnVf-P5CdJP_RhW1d5ghD_rC7x0bdbKgaYHfMIElHsj8h1NA1rTfAWXvAIerZh8U8vsnNP1tXgQcEtSqpkhXEfWvyuSjFOkqhXel7QtylouArs23P4CdP8S_7KApeM7ViKk Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 4ebb258de32f40c68f86e4b401efde5d Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:11:55.826387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4ebb258de32f40c68f86e4b401efde5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 4ebb258de32f40c68f86e4b401efde5d Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1763361212 Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-ServerRescueNegativeTestJSON-1763361212-project Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: f1815cf2b3f347eb8276769cc30cf116 Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1763361212-project Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 41685b83-a75b-4abc-814c-c9a4424f2c65 could not be found. Oct 06 11:11:55.827969 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '41685b83-a75b-4abc-814c-c9a4424f2c65'} Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41685b83-a75b-4abc-814c-c9a4424f2c65 could not be found. Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:11:55.830262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41685b83-a75b-4abc-814c-c9a4424f2c65 could not be found. Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41685b83-a75b-4abc-814c-c9a4424f2c65 could not be found. Oct 06 11:11:55.831696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:11:55.833151 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] Returning 404 to user: Instance 41685b83-a75b-4abc-814c-c9a4424f2c65 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:11:55.833151 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c41c69b3-6900-4b64-a334-600575f69c64 tempest-ServerRescueNegativeTestJSON-1763361212 tempest-ServerRescueNegativeTestJSON-1763361212-project] 10.222.0.52 "GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65" status: 404 len: 111 microversion: 2.1 time: 0.030827 Oct 06 11:11:55.833151 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 417/842] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:55 2022] GET /compute/v2.1/servers/41685b83-a75b-4abc-814c-c9a4424f2c65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:11:55.997887 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7803cb93-30e9-41c5-9df1-a2f33bfeeef9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:55.998628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7803cb93-30e9-41c5-9df1-a2f33bfeeef9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:56.005961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7803cb93-30e9-41c5-9df1-a2f33bfeeef9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:56.006370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7803cb93-30e9-41c5-9df1-a2f33bfeeef9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:56.006833 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7803cb93-30e9-41c5-9df1-a2f33bfeeef9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:56.007534 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7803cb93-30e9-41c5-9df1-a2f33bfeeef9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:56.008027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7803cb93-30e9-41c5-9df1-a2f33bfeeef9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:56.008461 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7803cb93-30e9-41c5-9df1-a2f33bfeeef9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:56.418554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7803cb93-30e9-41c5-9df1-a2f33bfeeef9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:56.426651 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7803cb93-30e9-41c5-9df1-a2f33bfeeef9 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1363 microversion: 2.1 time: 0.433592 Oct 06 11:11:56.427219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 426/843] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:55 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1363 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:57.449861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f19a7c1-7c4c-468f-941f-6ec6b686f184 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:57.450649 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4f19a7c1-7c4c-468f-941f-6ec6b686f184 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:57.458563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f19a7c1-7c4c-468f-941f-6ec6b686f184 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:57.459251 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f19a7c1-7c4c-468f-941f-6ec6b686f184 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:57.459684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f19a7c1-7c4c-468f-941f-6ec6b686f184 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:57.460427 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f19a7c1-7c4c-468f-941f-6ec6b686f184 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:57.461028 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f19a7c1-7c4c-468f-941f-6ec6b686f184 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:57.461448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f19a7c1-7c4c-468f-941f-6ec6b686f184 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:57.848967 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f19a7c1-7c4c-468f-941f-6ec6b686f184 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:57.856619 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f19a7c1-7c4c-468f-941f-6ec6b686f184 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1363 microversion: 2.1 time: 0.410693 Oct 06 11:11:57.857292 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 418/844] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:57 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1363 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:11:58.880939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6b2a296-2cec-42bb-b89f-7dce96f3d9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:11:58.881765 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d6b2a296-2cec-42bb-b89f-7dce96f3d9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:11:58.888614 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6b2a296-2cec-42bb-b89f-7dce96f3d9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:58.889207 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6b2a296-2cec-42bb-b89f-7dce96f3d9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:58.889767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6b2a296-2cec-42bb-b89f-7dce96f3d9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:58.890573 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6b2a296-2cec-42bb-b89f-7dce96f3d9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:11:58.891181 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6b2a296-2cec-42bb-b89f-7dce96f3d9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:11:58.892060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6b2a296-2cec-42bb-b89f-7dce96f3d9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:11:59.079985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d6b2a296-2cec-42bb-b89f-7dce96f3d9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:11:59.088254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6b2a296-2cec-42bb-b89f-7dce96f3d9e5 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1363 microversion: 2.1 time: 0.211110 Oct 06 11:11:59.088840 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 427/845] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:11:58 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:12:00.112890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47b9b75f-037e-409d-945f-2b8cca0f43a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:00.113501 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-47b9b75f-037e-409d-945f-2b8cca0f43a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:00.119864 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47b9b75f-037e-409d-945f-2b8cca0f43a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:00.120356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47b9b75f-037e-409d-945f-2b8cca0f43a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:00.120787 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47b9b75f-037e-409d-945f-2b8cca0f43a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:00.121473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47b9b75f-037e-409d-945f-2b8cca0f43a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:00.121920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47b9b75f-037e-409d-945f-2b8cca0f43a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:00.122341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47b9b75f-037e-409d-945f-2b8cca0f43a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:00.257145 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-47b9b75f-037e-409d-945f-2b8cca0f43a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:00.265073 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-47b9b75f-037e-409d-945f-2b8cca0f43a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1363 microversion: 2.1 time: 0.156713 Oct 06 11:12:00.265638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 419/846] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:12:00 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:12:00.884733 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-265a8ad8-685b-48d6-9122-5ccb3faa55d7 req-2bfcc63b-9c7d-4514-b2b1-2c93bc0d4ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562fb9bc-717f-4fea-9e1d-3b3637138ca8", "name": "network-vif-plugged", "status": "completed", "tag": "a1ce9ffa-2969-4b3f-8579-49451048adf4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:12:00.890367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:00.897709 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-265a8ad8-685b-48d6-9122-5ccb3faa55d7 req-2bfcc63b-9c7d-4514-b2b1-2c93bc0d4ef3 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:00.898200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-265a8ad8-685b-48d6-9122-5ccb3faa55d7 req-2bfcc63b-9c7d-4514-b2b1-2c93bc0d4ef3 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:00.898635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-265a8ad8-685b-48d6-9122-5ccb3faa55d7 req-2bfcc63b-9c7d-4514-b2b1-2c93bc0d4ef3 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:00.911868 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-265a8ad8-685b-48d6-9122-5ccb3faa55d7 req-2bfcc63b-9c7d-4514-b2b1-2c93bc0d4ef3 service nova] Creating event network-vif-plugged:a1ce9ffa-2969-4b3f-8579-49451048adf4 for instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 on hv-cinder-86020 Oct 06 11:12:00.917550 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-265a8ad8-685b-48d6-9122-5ccb3faa55d7 req-2bfcc63b-9c7d-4514-b2b1-2c93bc0d4ef3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036859 Oct 06 11:12:00.918843 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 428/847] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:12:01.289020 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e33abc3-05ae-4ff2-9525-1c4ceb65af34 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:01.289642 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e33abc3-05ae-4ff2-9525-1c4ceb65af34 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:01.296078 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e33abc3-05ae-4ff2-9525-1c4ceb65af34 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:01.296569 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e33abc3-05ae-4ff2-9525-1c4ceb65af34 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:01.297017 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e33abc3-05ae-4ff2-9525-1c4ceb65af34 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:01.298243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e33abc3-05ae-4ff2-9525-1c4ceb65af34 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:01.298699 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e33abc3-05ae-4ff2-9525-1c4ceb65af34 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:01.299126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e33abc3-05ae-4ff2-9525-1c4ceb65af34 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:01.443464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8e33abc3-05ae-4ff2-9525-1c4ceb65af34 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:01.451828 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e33abc3-05ae-4ff2-9525-1c4ceb65af34 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1363 microversion: 2.1 time: 0.166693 Oct 06 11:12:01.452412 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 420/848] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:12:01 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:12:02.472439 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:02.477326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65033472-ff9d-49f6-b436-8470ee6c5171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:02.478066 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65033472-ff9d-49f6-b436-8470ee6c5171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:02.488230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65033472-ff9d-49f6-b436-8470ee6c5171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:02.488732 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65033472-ff9d-49f6-b436-8470ee6c5171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:02.489242 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65033472-ff9d-49f6-b436-8470ee6c5171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:02.489898 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65033472-ff9d-49f6-b436-8470ee6c5171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:02.490359 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65033472-ff9d-49f6-b436-8470ee6c5171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:02.490795 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65033472-ff9d-49f6-b436-8470ee6c5171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:02.682377 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-65033472-ff9d-49f6-b436-8470ee6c5171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:02.692936 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65033472-ff9d-49f6-b436-8470ee6c5171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1363 microversion: 2.1 time: 0.221263 Oct 06 11:12:02.694341 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 429/849] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:12:02 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:12:03.719942 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f888fc8-51d9-4c0c-a2c2-2a9e7f79dfb7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:03.720579 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f888fc8-51d9-4c0c-a2c2-2a9e7f79dfb7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:03.727126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f888fc8-51d9-4c0c-a2c2-2a9e7f79dfb7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:03.727619 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f888fc8-51d9-4c0c-a2c2-2a9e7f79dfb7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:03.728088 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f888fc8-51d9-4c0c-a2c2-2a9e7f79dfb7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:03.728797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f888fc8-51d9-4c0c-a2c2-2a9e7f79dfb7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:03.729254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f888fc8-51d9-4c0c-a2c2-2a9e7f79dfb7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:03.729689 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f888fc8-51d9-4c0c-a2c2-2a9e7f79dfb7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:03.865599 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f888fc8-51d9-4c0c-a2c2-2a9e7f79dfb7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:03.873431 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f888fc8-51d9-4c0c-a2c2-2a9e7f79dfb7 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1547 microversion: 2.1 time: 0.157482 Oct 06 11:12:03.874085 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 421/850] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:12:03 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:12:03.898285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9a135c08-8d2d-44e1-8307-5013a7a08ad1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:03.898797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9a135c08-8d2d-44e1-8307-5013a7a08ad1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:03.905240 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a135c08-8d2d-44e1-8307-5013a7a08ad1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:03.905855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a135c08-8d2d-44e1-8307-5013a7a08ad1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:03.906169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a135c08-8d2d-44e1-8307-5013a7a08ad1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:03.906961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a135c08-8d2d-44e1-8307-5013a7a08ad1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:03.907496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a135c08-8d2d-44e1-8307-5013a7a08ad1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:03.908020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a135c08-8d2d-44e1-8307-5013a7a08ad1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:03.986908 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9a135c08-8d2d-44e1-8307-5013a7a08ad1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092886 Oct 06 11:12:03.987507 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 430/851] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Oct 6 11:12:03 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:12:04.758708 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27ad17f9-b9bd-45a5-b909-00629799c4a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:04.759569 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-27ad17f9-b9bd-45a5-b909-00629799c4a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:04.766127 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ad17f9-b9bd-45a5-b909-00629799c4a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:04.766773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ad17f9-b9bd-45a5-b909-00629799c4a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:04.767286 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ad17f9-b9bd-45a5-b909-00629799c4a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:04.768089 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ad17f9-b9bd-45a5-b909-00629799c4a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:04.768617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ad17f9-b9bd-45a5-b909-00629799c4a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:04.769061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27ad17f9-b9bd-45a5-b909-00629799c4a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:04.903135 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-27ad17f9-b9bd-45a5-b909-00629799c4a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:04.912463 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27ad17f9-b9bd-45a5-b909-00629799c4a3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1592 microversion: 2.1 time: 0.157519 Oct 06 11:12:04.913158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 422/852] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:12:04 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1592 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:12:04.932281 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-96c11020-914d-4c64-bdae-b96ee23fce34 req-3625b5f4-5cec-4b3b-89b5-c4b898394e51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562fb9bc-717f-4fea-9e1d-3b3637138ca8", "tag": "a1ce9ffa-2969-4b3f-8579-49451048adf4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:12:04.943797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-96c11020-914d-4c64-bdae-b96ee23fce34 req-3625b5f4-5cec-4b3b-89b5-c4b898394e51 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:04.944327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-96c11020-914d-4c64-bdae-b96ee23fce34 req-3625b5f4-5cec-4b3b-89b5-c4b898394e51 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:04.944935 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-96c11020-914d-4c64-bdae-b96ee23fce34 req-3625b5f4-5cec-4b3b-89b5-c4b898394e51 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:04.957056 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-96c11020-914d-4c64-bdae-b96ee23fce34 req-3625b5f4-5cec-4b3b-89b5-c4b898394e51 service nova] Creating event network-changed:a1ce9ffa-2969-4b3f-8579-49451048adf4 for instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 on hv-cinder-86020 Oct 06 11:12:04.962602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-96c11020-914d-4c64-bdae-b96ee23fce34 req-3625b5f4-5cec-4b3b-89b5-c4b898394e51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034429 Oct 06 11:12:04.963458 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 431/853] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:12:06.812301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ee18c8ce-c621-48a2-852d-4fbaaac90f63 req-41e60846-95cd-499e-b04c-bc3ab6804686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc20029-503a-4c89-b422-088e3676b9c4", "tag": "94650b61-76aa-4105-9fd3-7f1db6829887"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:12:06.822662 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ee18c8ce-c621-48a2-852d-4fbaaac90f63 req-41e60846-95cd-499e-b04c-bc3ab6804686 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:06.823388 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ee18c8ce-c621-48a2-852d-4fbaaac90f63 req-41e60846-95cd-499e-b04c-bc3ab6804686 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:06.824014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ee18c8ce-c621-48a2-852d-4fbaaac90f63 req-41e60846-95cd-499e-b04c-bc3ab6804686 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:06.836228 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ee18c8ce-c621-48a2-852d-4fbaaac90f63 req-41e60846-95cd-499e-b04c-bc3ab6804686 service nova] Creating event network-changed:94650b61-76aa-4105-9fd3-7f1db6829887 for instance 5fc20029-503a-4c89-b422-088e3676b9c4 on hv-cinder-86020 Oct 06 11:12:06.841531 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ee18c8ce-c621-48a2-852d-4fbaaac90f63 req-41e60846-95cd-499e-b04c-bc3ab6804686 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032871 Oct 06 11:12:06.845610 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 423/854] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:12:08.239378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a933769-553d-4c6b-b204-929aa3619b69 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-335297420"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:12:08.240116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a933769-553d-4c6b-b204-929aa3619b69 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:08.246221 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a933769-553d-4c6b-b204-929aa3619b69 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:08.246715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a933769-553d-4c6b-b204-929aa3619b69 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:08.247156 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a933769-553d-4c6b-b204-929aa3619b69 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:08.247859 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a933769-553d-4c6b-b204-929aa3619b69 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:08.248332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a933769-553d-4c6b-b204-929aa3619b69 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:08.248767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a933769-553d-4c6b-b204-929aa3619b69 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:08.372900 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.network.security_group_api [None req-7a933769-553d-4c6b-b204-929aa3619b69 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Adding security group 11ee5993-abd0-464f-9325-9dab2779718f to port 94650b61-76aa-4105-9fd3-7f1db6829887 Oct 06 11:12:08.735711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a933769-553d-4c6b-b204-929aa3619b69 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "POST /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/action" status: 202 len: 0 microversion: 2.1 time: 0.500629 Oct 06 11:12:08.736685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 432/855] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:12:08 2022] POST /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:12:08.746419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cbf495da-c633-47e2-b9b6-f6e816979fd5 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:08.747126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cbf495da-c633-47e2-b9b6-f6e816979fd5 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:08.758840 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-35dcd845-2476-446f-930b-c2bfe511c13e req-7f7430aa-2895-41fa-9bbf-5017f773652e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc20029-503a-4c89-b422-088e3676b9c4", "tag": "94650b61-76aa-4105-9fd3-7f1db6829887"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:12:08.771019 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf495da-c633-47e2-b9b6-f6e816979fd5 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:08.771808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf495da-c633-47e2-b9b6-f6e816979fd5 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:08.772874 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf495da-c633-47e2-b9b6-f6e816979fd5 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:08.773662 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf495da-c633-47e2-b9b6-f6e816979fd5 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:08.774896 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf495da-c633-47e2-b9b6-f6e816979fd5 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:08.776205 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf495da-c633-47e2-b9b6-f6e816979fd5 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:08.780080 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-35dcd845-2476-446f-930b-c2bfe511c13e req-7f7430aa-2895-41fa-9bbf-5017f773652e service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:08.780888 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-35dcd845-2476-446f-930b-c2bfe511c13e req-7f7430aa-2895-41fa-9bbf-5017f773652e service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:08.782155 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-35dcd845-2476-446f-930b-c2bfe511c13e req-7f7430aa-2895-41fa-9bbf-5017f773652e service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:08.791800 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:08.810109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-35dcd845-2476-446f-930b-c2bfe511c13e req-7f7430aa-2895-41fa-9bbf-5017f773652e service nova] Creating event network-changed:94650b61-76aa-4105-9fd3-7f1db6829887 for instance 5fc20029-503a-4c89-b422-088e3676b9c4 on hv-cinder-86020 Oct 06 11:12:08.817559 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-35dcd845-2476-446f-930b-c2bfe511c13e req-7f7430aa-2895-41fa-9bbf-5017f773652e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064765 Oct 06 11:12:08.820363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 433/856] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:12:09.016464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cbf495da-c633-47e2-b9b6-f6e816979fd5 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:09.027334 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cbf495da-c633-47e2-b9b6-f6e816979fd5 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1756 microversion: 2.1 time: 0.286523 Oct 06 11:12:09.028295 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 424/857] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:12:08 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1756 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:12:46.569774 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:46.570514 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:46.575196 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db87fb3f-12d8-47e3-a77e-3fa11da2223c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:46.575784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db87fb3f-12d8-47e3-a77e-3fa11da2223c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:46.583344 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db87fb3f-12d8-47e3-a77e-3fa11da2223c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:46.583883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db87fb3f-12d8-47e3-a77e-3fa11da2223c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:46.584324 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db87fb3f-12d8-47e3-a77e-3fa11da2223c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:46.585018 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db87fb3f-12d8-47e3-a77e-3fa11da2223c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:46.585471 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db87fb3f-12d8-47e3-a77e-3fa11da2223c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:46.585895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db87fb3f-12d8-47e3-a77e-3fa11da2223c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:46.611276 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db87fb3f-12d8-47e3-a77e-3fa11da2223c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/ips" status: 200 len: 152 microversion: 2.20 time: 0.043075 Oct 06 11:12:46.612057 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 434/858] 10.222.0.52 () {60 vars in 1289 bytes} [Thu Oct 6 11:12:46 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 11:12:52.681636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc2da452-a1d2-4563-acc4-f178021cd48d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:12:52.682228 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc2da452-a1d2-4563-acc4-f178021cd48d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:52.684417 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=41 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:52.685073 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=5 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:52.691264 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2da452-a1d2-4563-acc4-f178021cd48d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:52.691754 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2da452-a1d2-4563-acc4-f178021cd48d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:52.692224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2da452-a1d2-4563-acc4-f178021cd48d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:52.692923 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2da452-a1d2-4563-acc4-f178021cd48d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:52.693380 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2da452-a1d2-4563-acc4-f178021cd48d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:52.693808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2da452-a1d2-4563-acc4-f178021cd48d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:52.716976 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-dc2da452-a1d2-4563-acc4-f178021cd48d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lazy-loading 'flavor' on Instance uuid 16531807-aeec-439c-8671-699762bf520f {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:12:52.905648 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc2da452-a1d2-4563-acc4-f178021cd48d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "POST /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/action" status: 202 len: 0 microversion: 2.20 time: 0.227824 Oct 06 11:12:52.909526 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 425/859] 10.222.0.52 () {62 vars in 1319 bytes} [Thu Oct 6 11:12:52 2022] POST /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:12:52.914956 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:52.915602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:52.923463 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:52.923984 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:52.924413 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:52.925125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:52.925587 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:52.926014 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:53.061128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:53.069183 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:53.070629 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:53.071792 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-810b248a-7963-4d80-8528-572f2999ff5a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.160687 Oct 06 11:12:53.072382 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 435/860] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:12:52 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:12:54.098713 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:54.099431 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:54.108828 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:54.109330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:54.109772 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:54.110476 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:54.110938 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:54.111431 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:54.245337 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:54.253373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:54.254889 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:54.256076 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1f83b04a-acfa-49b7-863f-07399f8f120b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.162304 Oct 06 11:12:54.256670 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 426/861] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:12:54 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:12:55.282884 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:55.283499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:55.289944 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:55.290425 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:55.290859 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:55.291549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:55.292034 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:55.292462 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:55.423952 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:55.431851 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:55.433284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:55.434895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-32c5d995-509c-48a0-aa73-045d6fe756bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.155581 Oct 06 11:12:55.435526 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 436/862] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:12:55 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:12:56.460298 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:56.460913 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:56.467819 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:56.468332 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:56.468770 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:56.469494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:56.469946 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:56.470373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:56.596439 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:56.604569 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:56.606724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:56.607963 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1be4b0d-d1c9-4738-b4a5-f87bf9b391e1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.151544 Oct 06 11:12:56.608533 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 427/863] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:12:56 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:12:57.633744 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:57.634381 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:57.641040 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:57.641535 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:57.641971 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:57.642720 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:57.643127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:57.643556 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:57.773901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:57.782243 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:57.783670 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:57.784867 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f08d089e-06cb-4ad2-9fd3-ac8524c33084 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.155327 Oct 06 11:12:57.785426 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 437/864] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:12:57 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:12:58.811160 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:58.812719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:58.818065 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:58.818566 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:58.819006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:58.819718 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:58.820202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:58.820633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:58.954430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:58.962503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:58.963954 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:12:58.965090 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-21129572-8695-47ee-928b-0e17bf0307ac tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.158475 Oct 06 11:12:58.965648 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 428/865] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:12:58 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:12:59.990233 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:12:59.990866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:12:59.997474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:59.997954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:59.998385 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:12:59.999070 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:12:59.999521 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:12:59.999977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:00.127422 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:00.135350 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:00.136807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:00.138559 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b94a49ea-a547-4f81-85d5-cd1a45892be7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.152242 Oct 06 11:13:00.139107 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 438/866] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:12:59 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:01.170908 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:01.171560 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:01.178029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:01.178451 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:01.178890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:01.179587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:01.180069 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:01.180497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:01.312140 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:01.320201 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:01.321643 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:01.322790 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31358c9a-c28e-4a26-8d54-02d9fef8b7b7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.156370 Oct 06 11:13:01.323343 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 429/867] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:01 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:02.349708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:02.350329 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:02.357072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:02.357567 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:02.358015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:02.358719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:02.359182 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:02.359612 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:02.498920 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:02.507106 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:02.508577 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:02.509724 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c9d288d-1643-4076-8339-19ae5b5667df tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.163932 Oct 06 11:13:02.510279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 439/868] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:02 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:03.538056 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:03.538610 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:03.546421 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:03.546912 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:03.547347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:03.548074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:03.548527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:03.548975 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:03.677871 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:03.686639 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:03.688099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:03.689246 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31758f7d-b929-49d9-a80c-f0fee33671ee tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.157097 Oct 06 11:13:03.689804 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 430/869] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:03 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:04.714143 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:04.714695 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:04.721475 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:04.722011 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:04.722463 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:04.723229 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:04.723749 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:04.724224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:04.859941 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:04.868459 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:04.870025 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:04.871287 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb9dfa9a-02d8-4eed-84be-a0bbb3eb63ad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.161421 Oct 06 11:13:04.872522 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 440/870] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:04 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:05.898698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:05.899348 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:05.907731 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:05.908342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:05.908857 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:05.909619 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:05.910160 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:05.910645 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:06.043211 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:06.054578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:06.057832 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:06.059342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3ae2b707-4a53-4a39-aeb6-5d19eefa2a29 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.164760 Oct 06 11:13:06.061415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 431/871] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:05 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:07.086483 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:07.087191 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:07.094681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:07.095249 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:07.095867 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:07.096567 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:07.097026 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:07.097451 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:07.499581 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:07.507590 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:07.509102 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:07.510266 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea661048-5274-4be1-a8b8-f970fbaf5a9d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.427697 Oct 06 11:13:07.510808 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 441/872] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:07 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:08.536531 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:08.537121 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:08.543510 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:08.544031 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:08.544465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:08.545149 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:08.545599 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:08.546023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:08.679961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:08.688190 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:08.689622 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:08.690761 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4d0d1300-2f0c-458b-af12-0a28758b28d5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.158297 Oct 06 11:13:08.691319 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 432/873] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:08 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:09.716434 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:09.716977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:09.723563 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:09.724095 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:09.724540 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:09.725240 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:09.725700 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:09.726155 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:09.856432 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:09.864601 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:09.866026 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:09.867194 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1689c241-98bc-4c33-b94a-e322fff982aa tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1745 microversion: 2.20 time: 0.155210 Oct 06 11:13:09.867780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 442/874] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:09 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:10.893683 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:10.894284 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:10.900961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:10.901446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:10.901882 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:10.902572 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:10.903021 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:10.903446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:11.037472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:11.045409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:11.046839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:11.048301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-edbf49d1-9e12-43da-92d5-23565fed0628 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1745 microversion: 2.20 time: 0.158551 Oct 06 11:13:11.048881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 433/875] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:10 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:12.074207 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:12.074753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:12.081633 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:12.082122 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:12.082560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:12.083254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:12.083711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:12.084187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:12.222285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:12.230347 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:12.231783 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:12.233571 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1303266b-fe7a-431f-b750-17d3bc88dbf8 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1745 microversion: 2.20 time: 0.163472 Oct 06 11:13:12.234125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 443/876] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:12 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:13.259440 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:13.260015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7d735719-8a89-4e0b-92ec-4f5c52540ee3 req-411756c3-92a4-4a8c-ade5-6ed5bcfd2422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16531807-aeec-439c-8671-699762bf520f", "name": "network-vif-plugged", "status": "completed", "tag": "d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:13:13.261100 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:13.268840 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:13.269945 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:13.270377 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7d735719-8a89-4e0b-92ec-4f5c52540ee3 req-411756c3-92a4-4a8c-ade5-6ed5bcfd2422 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:13.270560 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:13.271256 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:13.271676 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7d735719-8a89-4e0b-92ec-4f5c52540ee3 req-411756c3-92a4-4a8c-ade5-6ed5bcfd2422 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:13.271796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:13.272695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:13.272991 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7d735719-8a89-4e0b-92ec-4f5c52540ee3 req-411756c3-92a4-4a8c-ade5-6ed5bcfd2422 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:13.288665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-7d735719-8a89-4e0b-92ec-4f5c52540ee3 req-411756c3-92a4-4a8c-ade5-6ed5bcfd2422 service nova] Creating event network-vif-plugged:d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d for instance 16531807-aeec-439c-8671-699762bf520f on hv-cinder-86020 Oct 06 11:13:13.293834 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7d735719-8a89-4e0b-92ec-4f5c52540ee3 req-411756c3-92a4-4a8c-ade5-6ed5bcfd2422 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038120 Oct 06 11:13:13.294643 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 444/877] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:13:13.413075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:13.421385 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:13.422981 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:13.424347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d3bdfec9-371d-4e7c-928a-d9d71b1a8d68 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1745 microversion: 2.20 time: 0.169039 Oct 06 11:13:13.424922 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 434/878] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:13 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:14.450809 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:14.451517 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:14.458673 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:14.459165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:14.459635 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:14.460370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:14.460865 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:14.461299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:14.593960 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:14.601969 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:14.603459 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:14.604896 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d02bf12-2e2f-49c1-b5d1-f0cc2488a89e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1745 microversion: 2.20 time: 0.158325 Oct 06 11:13:14.605494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 445/879] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:14 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:15.632928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:15.633591 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:15.640848 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:15.641328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:15.641807 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:15.642445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:15.642918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:15.643340 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:15.781416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:15.789592 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:15.791151 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:15.792389 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-96a9633b-78b5-4d0a-b8d4-67ea73d4d225 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1745 microversion: 2.20 time: 0.163459 Oct 06 11:13:15.792952 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 435/880] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:15 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:16.818347 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:16.818957 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:16.822656 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=25 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:16.830404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:16.830404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:16.830404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:16.830404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:16.830798 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:16.830798 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:16.835225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=67 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:16.967045 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:16.975090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:16.976558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:16.977699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d57d1965-5ed6-4a60-b44c-d7e145023874 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1745 microversion: 2.20 time: 0.163257 Oct 06 11:13:16.978247 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 446/881] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:16 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:18.003181 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:18.003829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:18.009900 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:18.010394 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:18.010834 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:18.011532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:18.012020 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:18.012449 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:18.147701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:18.157901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:18.159776 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:18.160545 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4118af3a-ddb8-4323-93b4-333477eddef7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.161308 Oct 06 11:13:18.161104 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 436/882] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:17 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:19.186147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:19.186924 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:19.193143 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:19.193634 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:19.194090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:19.194770 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:19.195220 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:19.195641 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:19.330307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:19.338724 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:19.340282 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:19.341511 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9ddaf8c-05ab-4b7c-93f5-7725c5f50a33 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.159438 Oct 06 11:13:19.342180 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 447/883] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:19 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:20.368811 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:20.369523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:20.376732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:20.377515 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:20.378170 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:20.379087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:20.379704 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:20.380323 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:20.520751 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:20.530525 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:20.532003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:20.533172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-984bfc0d-1291-4924-88f0-35955b9832bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.168263 Oct 06 11:13:20.547407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 437/884] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:20 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:21.558919 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:21.559560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:21.566804 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:21.567616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:21.568423 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:21.568791 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:21.569426 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:21.569873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:21.717873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:21.727116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:21.728668 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:21.730199 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebdff458-0ec8-4d3f-ace6-d4d848de0502 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.175217 Oct 06 11:13:21.731467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 448/885] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:21 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:22.761339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:22.762056 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:22.765269 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=27 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:22.770883 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:22.771381 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:22.771822 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:22.772813 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:22.773272 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:22.773701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:22.776334 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:22.918541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:22.928255 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:22.930079 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:22.931282 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-084ff1f4-6c2b-47c8-9354-26fc52ba97bd tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.174109 Oct 06 11:13:22.944716 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 438/886] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:22 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:23.957364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:23.958125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:23.964790 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:23.965283 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:23.965727 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:23.966429 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:23.966889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:23.967430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:24.113713 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:24.122172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:24.123653 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:24.124852 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d83c6853-1f21-4015-8863-484df3de4ca5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.171448 Oct 06 11:13:24.125475 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 449/887] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:23 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:25.150627 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:25.151274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:25.158406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:25.158894 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:25.159333 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:25.160077 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:25.160572 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:25.161010 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:25.301948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:25.312366 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:25.313996 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:25.315177 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ca12363b-7606-4850-b5da-cf54ff3bb380 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.168738 Oct 06 11:13:25.316469 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 439/888] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:25 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:26.341818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:26.343081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:26.349704 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:26.350191 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:26.350901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:26.351671 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:26.352232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:26.352751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:26.512459 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:26.520838 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:26.522615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:26.523922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37e8bbbb-556d-4546-bf81-132179475ebc tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.185965 Oct 06 11:13:26.527880 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 450/889] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:26 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:27.550380 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:27.551268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:27.559284 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:27.559765 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:27.560353 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:27.561998 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:27.562391 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:27.562838 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:27.708506 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:27.716932 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:27.720576 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:27.721741 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-76fe131d-9d41-46b8-9b59-525e9b5a153b tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.175910 Oct 06 11:13:27.722495 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 440/890] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:27 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:28.749839 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:28.751167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:28.758568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:28.761159 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:28.762376 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:28.763274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:28.763820 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:28.764699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:29.101887 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:29.112028 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:29.113752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:29.115149 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5617b62-03b9-45be-b36b-b667d1ae4451 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.369918 Oct 06 11:13:29.115725 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 451/891] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:28 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:30.141513 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:30.142134 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:30.148920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:30.149412 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:30.149848 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:30.150543 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:30.150995 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:30.151420 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:30.291140 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:30.299949 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:30.301376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:30.302513 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-db9f7578-14ed-450d-a989-fee2a107de6e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1740 microversion: 2.20 time: 0.165524 Oct 06 11:13:30.303070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 441/892] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:30 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:31.328368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:31.329083 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:31.335254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:31.335861 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:31.336362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:31.337119 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:31.337641 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:31.338143 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:31.536627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:31.544640 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:31.546694 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:31.547875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-def903b5-040b-4eea-880c-ddc8ee097042 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1722 microversion: 2.20 time: 0.223803 Oct 06 11:13:31.548425 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 452/893] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:31 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:32.574985 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:32.575600 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:32.582948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:32.583437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:32.583911 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:32.584619 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:32.585075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:32.585649 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:32.716003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:32.724370 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:32.725807 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:32.726957 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5dd829ef-cbdb-4f59-9713-90c482e48f32 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1722 microversion: 2.20 time: 0.155970 Oct 06 11:13:32.727555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 442/894] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:32 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:33.360198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e6f3590b-2988-4c58-85ff-84ae26d42b6b req-6e1e08a8-38da-4b26-8d0e-24598a84e34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16531807-aeec-439c-8671-699762bf520f", "name": "network-vif-unplugged", "status": "completed", "tag": "d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:13:33.371813 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e6f3590b-2988-4c58-85ff-84ae26d42b6b req-6e1e08a8-38da-4b26-8d0e-24598a84e34e service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:33.372415 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e6f3590b-2988-4c58-85ff-84ae26d42b6b req-6e1e08a8-38da-4b26-8d0e-24598a84e34e service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:33.372912 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e6f3590b-2988-4c58-85ff-84ae26d42b6b req-6e1e08a8-38da-4b26-8d0e-24598a84e34e service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:33.384877 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e6f3590b-2988-4c58-85ff-84ae26d42b6b req-6e1e08a8-38da-4b26-8d0e-24598a84e34e service nova] Creating event network-vif-unplugged:d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d for instance 16531807-aeec-439c-8671-699762bf520f on hv-cinder-86020 Oct 06 11:13:33.390793 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e6f3590b-2988-4c58-85ff-84ae26d42b6b req-6e1e08a8-38da-4b26-8d0e-24598a84e34e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034585 Oct 06 11:13:33.392112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 453/895] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:13:33.752844 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:33.753452 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:33.759705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:33.760174 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:33.760607 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:33.761320 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:33.761771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:33.762191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:33.890686 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:33.899035 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:33.900512 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:33.901666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66bc6c27-f354-440f-945b-c4585711e03a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1725 microversion: 2.20 time: 0.152992 Oct 06 11:13:33.902231 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 443/896] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:33 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:33.926508 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-87f627ad-d555-446c-8dd7-3880f3e0ba43 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc367124-c2fc-4ef1-9561-9d955c1c1016"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:13:33.928960 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-87f627ad-d555-446c-8dd7-3880f3e0ba43 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:33.934943 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f627ad-d555-446c-8dd7-3880f3e0ba43 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:33.935445 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f627ad-d555-446c-8dd7-3880f3e0ba43 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:33.936430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f627ad-d555-446c-8dd7-3880f3e0ba43 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:33.937214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f627ad-d555-446c-8dd7-3880f3e0ba43 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:33.937670 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f627ad-d555-446c-8dd7-3880f3e0ba43 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:33.938094 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f627ad-d555-446c-8dd7-3880f3e0ba43 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:34.209410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-87f627ad-d555-446c-8dd7-3880f3e0ba43 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "POST /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287173 Oct 06 11:13:34.210025 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 454/897] 10.222.0.52 () {62 vars in 1364 bytes} [Thu Oct 6 11:13:33 2022] POST /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 11:13:34.335283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bac721bd-1ab0-4705-8ff0-838eedaab09c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:34.335773 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bac721bd-1ab0-4705-8ff0-838eedaab09c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:34.341584 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bac721bd-1ab0-4705-8ff0-838eedaab09c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:34.342071 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bac721bd-1ab0-4705-8ff0-838eedaab09c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:34.342505 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bac721bd-1ab0-4705-8ff0-838eedaab09c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:34.343252 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bac721bd-1ab0-4705-8ff0-838eedaab09c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:34.343703 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bac721bd-1ab0-4705-8ff0-838eedaab09c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:34.344150 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bac721bd-1ab0-4705-8ff0-838eedaab09c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:37.617414 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bac721bd-1ab0-4705-8ff0-838eedaab09c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "DELETE /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/os-volume_attachments/bc367124-c2fc-4ef1-9561-9d955c1c1016" status: 202 len: 0 microversion: 2.20 time: 3.285829 Oct 06 11:13:37.621532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 444/898] 10.222.0.52 () {60 vars in 1457 bytes} [Thu Oct 6 11:13:34 2022] DELETE /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/os-volume_attachments/bc367124-c2fc-4ef1-9561-9d955c1c1016 => generated 0 bytes in 3288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:13:37.683140 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96952852-ce05-4f7e-9116-96adff1c77f2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:13:37.683930 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96952852-ce05-4f7e-9116-96adff1c77f2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:37.690427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96952852-ce05-4f7e-9116-96adff1c77f2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:37.690917 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96952852-ce05-4f7e-9116-96adff1c77f2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:37.691362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96952852-ce05-4f7e-9116-96adff1c77f2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:37.692104 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96952852-ce05-4f7e-9116-96adff1c77f2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:37.692569 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96952852-ce05-4f7e-9116-96adff1c77f2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:37.693010 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96952852-ce05-4f7e-9116-96adff1c77f2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:37.722476 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96952852-ce05-4f7e-9116-96adff1c77f2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120603) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 11:13:37.790547 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96952852-ce05-4f7e-9116-96adff1c77f2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "POST /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/action" status: 202 len: 0 microversion: 2.20 time: 0.112123 Oct 06 11:13:37.791215 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 455/899] 10.222.0.52 () {62 vars in 1319 bytes} [Thu Oct 6 11:13:37 2022] POST /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:13:37.800027 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:37.800643 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:37.806920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:37.807401 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:37.807852 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:37.808621 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:37.809065 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:37.809482 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:37.945420 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:37.954098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:37.955557 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:37.956766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-33815d4d-4bc0-441d-ae87-0fad94983c2d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1673 microversion: 2.20 time: 0.161359 Oct 06 11:13:37.957322 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 445/900] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:37 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:38.984041 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:38.984699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:38.991407 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:38.991944 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:38.992427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:38.993149 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:38.993614 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:38.994047 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:39.137185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:39.145815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:39.147526 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:39.148749 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a892764-6c8e-4221-b7c3-bd26b4904dad tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.169388 Oct 06 11:13:39.149305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 456/901] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:38 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:13:40.175785 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:40.176419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:40.182733 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:40.183267 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:40.183646 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:40.184376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:40.184822 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:40.185237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:40.518723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:40.528265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:40.530142 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:40.532291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-89e31fc5-0ee4-425c-9821-32239c080027 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.361554 Oct 06 11:13:40.549010 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 446/902] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:40 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:41.559797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:41.560737 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:41.569675 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:41.570378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:41.570899 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:41.571698 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:41.572411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:41.573075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:41.714752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:41.725143 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:41.727027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:41.728495 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2eebddbe-a4fc-420d-87f5-a3c8877527cf tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.172480 Oct 06 11:13:41.729865 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 457/903] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:41 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:42.755872 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:42.756492 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:42.763187 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:42.763672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:42.764141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:42.765334 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:42.765820 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:42.766558 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:42.910002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:42.917998 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:42.919448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:42.920638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-29530dd1-6eaa-49e6-8548-2bdace80a4a6 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.168851 Oct 06 11:13:42.921378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 447/904] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:42 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:43.946497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:43.947857 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:43.955304 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:43.955811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:43.956348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:43.957249 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:43.957875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:43.958467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:44.132748 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:44.142081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:44.143645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:44.145114 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bfe87d36-9c13-4d9d-9968-1c81a19382f7 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.202463 Oct 06 11:13:44.145866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 458/905] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:43 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:45.172650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:45.173232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:45.179548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:45.180064 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:45.180590 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:45.181194 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:45.181651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:45.182068 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:45.345732 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:45.354939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:45.357142 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:45.359232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a7748260-a49b-4f7d-90da-633dd8e4d98d tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.190920 Oct 06 11:13:45.370364 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 448/906] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:45 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:46.385264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:46.386505 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:46.394144 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:46.394565 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:46.395013 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:46.396169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:46.396637 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:46.397466 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:46.542625 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:46.546351 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:46.566666 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:46.569458 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:46.573679 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0a3912e-1042-4775-9433-88df6e53a17a tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.192133 Oct 06 11:13:46.574647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 459/907] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:46 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:47.602633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:47.604192 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:47.612124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:47.612616 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:47.613123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:47.613873 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:47.614529 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:47.615127 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:47.737232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-30e7a19a-4e1e-40d8-a84c-55e3fab60eba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:13:47.740614 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-30e7a19a-4e1e-40d8-a84c-55e3fab60eba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:47.754651 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:47.758480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e7a19a-4e1e-40d8-a84c-55e3fab60eba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:47.759237 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e7a19a-4e1e-40d8-a84c-55e3fab60eba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:47.763284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e7a19a-4e1e-40d8-a84c-55e3fab60eba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:47.764158 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e7a19a-4e1e-40d8-a84c-55e3fab60eba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:47.765351 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e7a19a-4e1e-40d8-a84c-55e3fab60eba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:47.765788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e7a19a-4e1e-40d8-a84c-55e3fab60eba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:47.886307 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:47.898837 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:47.900753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:47.905984 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b1048eab-9dfd-4fd9-ae5b-04c4d66032ce tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.307892 Oct 06 11:13:47.925418 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 449/908] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:47 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:47.960323 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-30e7a19a-4e1e-40d8-a84c-55e3fab60eba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "POST /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/action" status: 202 len: 0 microversion: 2.1 time: 0.227633 Oct 06 11:13:47.964743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 460/909] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:13:47 2022] POST /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 11:13:47.972708 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62dfe62f-4060-4588-933b-d7122cb39109 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:47.973619 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62dfe62f-4060-4588-933b-d7122cb39109 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:47.981276 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62dfe62f-4060-4588-933b-d7122cb39109 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:47.982161 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62dfe62f-4060-4588-933b-d7122cb39109 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:47.982864 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62dfe62f-4060-4588-933b-d7122cb39109 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:47.983820 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62dfe62f-4060-4588-933b-d7122cb39109 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:47.984450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62dfe62f-4060-4588-933b-d7122cb39109 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:47.985079 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62dfe62f-4060-4588-933b-d7122cb39109 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:48.263076 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-62dfe62f-4060-4588-933b-d7122cb39109 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:48.278964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62dfe62f-4060-4588-933b-d7122cb39109 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1748 microversion: 2.1 time: 0.312672 Oct 06 11:13:48.301537 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 450/910] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:13:47 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1748 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:13:48.933747 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:48.934359 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:48.941012 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:48.941498 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:48.941961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:48.942673 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:48.943126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:48.943551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:49.095332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:49.103980 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:49.106489 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:49.108073 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f595161f-962c-4a62-a2d9-2081aca0cd2f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.178744 Oct 06 11:13:49.109684 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 461/911] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:48 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:49.308091 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1bb4232c-6c00-4330-9dca-295248e75d11 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:49.308857 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1bb4232c-6c00-4330-9dca-295248e75d11 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:49.315524 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bb4232c-6c00-4330-9dca-295248e75d11 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:49.316048 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bb4232c-6c00-4330-9dca-295248e75d11 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:49.316492 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bb4232c-6c00-4330-9dca-295248e75d11 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:49.317201 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bb4232c-6c00-4330-9dca-295248e75d11 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:49.317660 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bb4232c-6c00-4330-9dca-295248e75d11 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:49.318086 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bb4232c-6c00-4330-9dca-295248e75d11 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:49.785398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1bb4232c-6c00-4330-9dca-295248e75d11 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:49.793621 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1bb4232c-6c00-4330-9dca-295248e75d11 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1748 microversion: 2.1 time: 0.489457 Oct 06 11:13:49.794242 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 451/912] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:13:49 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1748 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:13:50.136075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:50.136970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:50.144040 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:50.144665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:50.145920 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:50.146797 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:50.147660 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:50.148195 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:50.359606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:50.368524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:50.370247 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:50.371850 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38524bc9-153e-42d5-bf19-83299ce24d10 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.239683 Oct 06 11:13:50.391975 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 462/913] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:50 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:50.818845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a76cc8b-ebaf-471f-a9bc-834a1c6a73cc tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:50.820392 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4a76cc8b-ebaf-471f-a9bc-834a1c6a73cc tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:50.826698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a76cc8b-ebaf-471f-a9bc-834a1c6a73cc tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:50.828197 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a76cc8b-ebaf-471f-a9bc-834a1c6a73cc tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:50.828805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a76cc8b-ebaf-471f-a9bc-834a1c6a73cc tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:50.829688 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a76cc8b-ebaf-471f-a9bc-834a1c6a73cc tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:50.830320 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a76cc8b-ebaf-471f-a9bc-834a1c6a73cc tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:50.830914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a76cc8b-ebaf-471f-a9bc-834a1c6a73cc tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:50.857409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:51.001240 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4a76cc8b-ebaf-471f-a9bc-834a1c6a73cc tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:51.010447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4a76cc8b-ebaf-471f-a9bc-834a1c6a73cc tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1748 microversion: 2.1 time: 0.195850 Oct 06 11:13:51.011322 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 452/914] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:13:50 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1748 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:13:51.411516 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:51.412949 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:51.426522 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:51.427049 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:51.427501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:51.428333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:51.428800 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:51.429237 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:51.838998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:51.852116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:51.853913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:51.855313 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-15ff9464-485d-4023-b0c7-6219fed7a997 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.447935 Oct 06 11:13:51.856605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 463/915] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:51 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:52.050662 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7c48a53-59f1-48c3-a1fd-e03d369c5f77 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:52.051381 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7c48a53-59f1-48c3-a1fd-e03d369c5f77 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:52.059277 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c48a53-59f1-48c3-a1fd-e03d369c5f77 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:52.059775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c48a53-59f1-48c3-a1fd-e03d369c5f77 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:52.060483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c48a53-59f1-48c3-a1fd-e03d369c5f77 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:52.062099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c48a53-59f1-48c3-a1fd-e03d369c5f77 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:52.062708 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c48a53-59f1-48c3-a1fd-e03d369c5f77 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:52.063453 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c48a53-59f1-48c3-a1fd-e03d369c5f77 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:52.236576 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7c48a53-59f1-48c3-a1fd-e03d369c5f77 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:52.246245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7c48a53-59f1-48c3-a1fd-e03d369c5f77 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1748 microversion: 2.1 time: 0.209038 Oct 06 11:13:52.255895 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 453/916] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:13:52 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1748 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:13:52.881917 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:52.882533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:52.889133 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:52.890819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:52.891282 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:52.892032 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:52.892500 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:52.892933 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:53.035092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:53.043351 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:53.044915 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:53.046625 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c583231d-a86b-42fc-87f9-c4af0b0bdc28 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.168689 Oct 06 11:13:53.047378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 464/917] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:52 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:53.275861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-342321e7-7b20-40f3-929a-d9c430e8613c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:53.276489 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-342321e7-7b20-40f3-929a-d9c430e8613c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:53.279087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=32 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:53.291054 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-342321e7-7b20-40f3-929a-d9c430e8613c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:53.291817 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-342321e7-7b20-40f3-929a-d9c430e8613c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:53.292452 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-342321e7-7b20-40f3-929a-d9c430e8613c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:53.294063 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-342321e7-7b20-40f3-929a-d9c430e8613c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:53.294861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-342321e7-7b20-40f3-929a-d9c430e8613c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:53.296082 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-342321e7-7b20-40f3-929a-d9c430e8613c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:53.486743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-342321e7-7b20-40f3-929a-d9c430e8613c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:53.495344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-342321e7-7b20-40f3-929a-d9c430e8613c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1748 microversion: 2.1 time: 0.227603 Oct 06 11:13:53.496446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 454/918] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:13:53 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1748 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:13:54.073249 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:54.074516 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:54.091069 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:54.091813 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:54.093570 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:54.094516 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:54.095140 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:54.095727 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:54.408470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:54.417721 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:54.419170 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:54.420369 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-649eba28-e397-46f4-aafc-8eeb9393ee79 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.351628 Oct 06 11:13:54.421762 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 465/919] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:54 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:54.522764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a03eba6a-7193-4273-b179-2c3374afd2d4 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:54.523448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a03eba6a-7193-4273-b179-2c3374afd2d4 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:54.529664 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a03eba6a-7193-4273-b179-2c3374afd2d4 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:54.531026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a03eba6a-7193-4273-b179-2c3374afd2d4 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:54.532208 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a03eba6a-7193-4273-b179-2c3374afd2d4 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:54.533002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a03eba6a-7193-4273-b179-2c3374afd2d4 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:54.533648 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a03eba6a-7193-4273-b179-2c3374afd2d4 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:54.534083 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a03eba6a-7193-4273-b179-2c3374afd2d4 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:54.724307 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a03eba6a-7193-4273-b179-2c3374afd2d4 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:54.735292 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a03eba6a-7193-4273-b179-2c3374afd2d4 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1748 microversion: 2.1 time: 0.217060 Oct 06 11:13:54.735936 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 455/920] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:13:54 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1748 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:13:55.455631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:55.456294 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:55.473257 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:55.486269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:55.486748 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:55.488090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:55.488561 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:55.489297 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:55.697315 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:55.707183 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:55.713722 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:55.715061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa499ba8-61bb-405d-85cc-1717b48c048f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.266755 Oct 06 11:13:55.716631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 466/921] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:55 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:55.763101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b31ea84-0872-4bab-9b7f-d2c80452c185 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:55.763764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b31ea84-0872-4bab-9b7f-d2c80452c185 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:55.771660 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b31ea84-0872-4bab-9b7f-d2c80452c185 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:55.773299 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b31ea84-0872-4bab-9b7f-d2c80452c185 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:55.777285 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b31ea84-0872-4bab-9b7f-d2c80452c185 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:55.778310 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b31ea84-0872-4bab-9b7f-d2c80452c185 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:55.778815 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b31ea84-0872-4bab-9b7f-d2c80452c185 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:55.779410 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b31ea84-0872-4bab-9b7f-d2c80452c185 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:56.052993 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6b31ea84-0872-4bab-9b7f-d2c80452c185 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:56.066793 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b31ea84-0872-4bab-9b7f-d2c80452c185 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.309031 Oct 06 11:13:56.084475 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 456/922] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:13:55 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:13:56.744485 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:56.744936 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:56.758488 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:56.759011 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:56.759465 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:56.760224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:56.760687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:56.761464 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:56.968942 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:56.977104 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:56.978538 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:56.979710 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-838c8aa1-4518-4b12-968b-66bf5d896ce1 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.239268 Oct 06 11:13:56.980307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 467/923] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:56 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 11:13:57.095827 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10cd847b-4417-4ee7-b858-fba3166765ad tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:57.096730 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10cd847b-4417-4ee7-b858-fba3166765ad tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:57.112261 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10cd847b-4417-4ee7-b858-fba3166765ad tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:57.112991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10cd847b-4417-4ee7-b858-fba3166765ad tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:57.113427 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10cd847b-4417-4ee7-b858-fba3166765ad tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:57.114135 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10cd847b-4417-4ee7-b858-fba3166765ad tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:57.114733 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10cd847b-4417-4ee7-b858-fba3166765ad tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:57.115623 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10cd847b-4417-4ee7-b858-fba3166765ad tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:57.284156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-10cd847b-4417-4ee7-b858-fba3166765ad tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:57.293846 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10cd847b-4417-4ee7-b858-fba3166765ad tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.203162 Oct 06 11:13:57.311760 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 457/924] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:13:57 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:13:57.316624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a87717af-c264-4e82-b7ee-dfa3b78df010 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Action: 'create', calling method: .version_select at 0x7f92a6f14550>, body: {"keypair": {"name": "tempest-TestShelveInstance-528045492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvmWZrH8Jr4+n5VMEyAGbMkWbqv+yu5KEIvXQcxbB1JhhNNq9+9gqU++Ul7980Zu6jyrVnq47pPIrAvk8Ie4p9me7pcfMMopjj2ldO71Fi7vbwqnRHZ9a9QRTmUrPBViw=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:13:57.332439 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-a87717af-c264-4e82-b7ee-dfa3b78df010 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Getting quotas for project 9376d8470a80416cb8e57eb650884883. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:13:57.337636 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-a87717af-c264-4e82-b7ee-dfa3b78df010 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Getting quotas for user e00353b2edab47e79578de680e4c4d1c and project 9376d8470a80416cb8e57eb650884883. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:13:57.363214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a87717af-c264-4e82-b7ee-dfa3b78df010 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.251971 Oct 06 11:13:57.364044 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 468/925] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Oct 6 11:13:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:13:58.009394 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:58.010852 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:58.019415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:58.020690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:58.021344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:58.022607 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:58.023273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:58.023959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:58.261141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:58.271408 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:58.273258 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:58.274452 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c9f43d28-ef76-421c-b9f0-d80ddbc0437e tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.272220 Oct 06 11:13:58.275489 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 458/926] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:58 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:58.324491 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1203a28-f294-41f2-ac07-efdf0fbedb14 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:58.325142 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1203a28-f294-41f2-ac07-efdf0fbedb14 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:58.334379 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1203a28-f294-41f2-ac07-efdf0fbedb14 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:58.334956 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1203a28-f294-41f2-ac07-efdf0fbedb14 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:58.335622 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1203a28-f294-41f2-ac07-efdf0fbedb14 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:58.336577 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1203a28-f294-41f2-ac07-efdf0fbedb14 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:58.337488 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1203a28-f294-41f2-ac07-efdf0fbedb14 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:58.338128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1203a28-f294-41f2-ac07-efdf0fbedb14 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:58.510767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1203a28-f294-41f2-ac07-efdf0fbedb14 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:58.523909 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1203a28-f294-41f2-ac07-efdf0fbedb14 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.208660 Oct 06 11:13:58.527903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 469/927] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:13:58 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:13:58.911690 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-38c4de76-1836-4f33-8d19-05375d886f71 req-1f592b68-ce43-450c-aff6-87aea9d3448d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16531807-aeec-439c-8671-699762bf520f", "name": "network-vif-plugged", "status": "completed", "tag": "d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:13:58.924963 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-38c4de76-1836-4f33-8d19-05375d886f71 req-1f592b68-ce43-450c-aff6-87aea9d3448d service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:58.925847 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-38c4de76-1836-4f33-8d19-05375d886f71 req-1f592b68-ce43-450c-aff6-87aea9d3448d service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:58.926367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-38c4de76-1836-4f33-8d19-05375d886f71 req-1f592b68-ce43-450c-aff6-87aea9d3448d service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:58.965273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-38c4de76-1836-4f33-8d19-05375d886f71 req-1f592b68-ce43-450c-aff6-87aea9d3448d service nova] Creating event network-vif-plugged:d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d for instance 16531807-aeec-439c-8671-699762bf520f on hv-cinder-86020 Oct 06 11:13:58.975266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-38c4de76-1836-4f33-8d19-05375d886f71 req-1f592b68-ce43-450c-aff6-87aea9d3448d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069764 Oct 06 11:13:58.977793 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 459/928] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:13:59.300067 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:59.300818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:59.306833 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:59.307321 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:59.307799 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:59.308516 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:59.308967 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:59.309391 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:59.549381 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08fb09c3-44b3-46fc-a95d-8cd36e430081 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:13:59.550934 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08fb09c3-44b3-46fc-a95d-8cd36e430081 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:13:59.557184 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fb09c3-44b3-46fc-a95d-8cd36e430081 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:59.557666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fb09c3-44b3-46fc-a95d-8cd36e430081 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:59.558100 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fb09c3-44b3-46fc-a95d-8cd36e430081 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:59.558797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fb09c3-44b3-46fc-a95d-8cd36e430081 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:13:59.559251 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fb09c3-44b3-46fc-a95d-8cd36e430081 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:13:59.559678 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fb09c3-44b3-46fc-a95d-8cd36e430081 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:13:59.563392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:59.572232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:59.573698 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:59.574882 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b620379-9ec1-4f52-9cfc-a724e79f5c31 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.278786 Oct 06 11:13:59.575450 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 470/929] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:13:59 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:13:59.714795 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-08fb09c3-44b3-46fc-a95d-8cd36e430081 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:13:59.723997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08fb09c3-44b3-46fc-a95d-8cd36e430081 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.179435 Oct 06 11:13:59.724578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 460/930] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:13:59 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:14:00.602421 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:00.603038 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:00.610634 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:00.611116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:00.611555 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:00.612552 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:00.613013 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:00.613443 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:00.749426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5eabaded-bac9-4cb0-a1cb-53930e4be481 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:00.750608 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5eabaded-bac9-4cb0-a1cb-53930e4be481 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:00.752292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:00.759561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eabaded-bac9-4cb0-a1cb-53930e4be481 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:00.760265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eabaded-bac9-4cb0-a1cb-53930e4be481 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:00.761380 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eabaded-bac9-4cb0-a1cb-53930e4be481 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:00.762200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:00.762586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eabaded-bac9-4cb0-a1cb-53930e4be481 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:00.763224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eabaded-bac9-4cb0-a1cb-53930e4be481 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:00.763863 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:00.764030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eabaded-bac9-4cb0-a1cb-53930e4be481 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:00.765945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-183c3e3c-7d3c-41d7-8e14-0ef382d5f7ba tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.167481 Oct 06 11:14:00.766697 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 471/931] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:14:00 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:14:00.968273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5eabaded-bac9-4cb0-a1cb-53930e4be481 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:00.977614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5eabaded-bac9-4cb0-a1cb-53930e4be481 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.233214 Oct 06 11:14:00.978186 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 461/932] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:00 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:01.792895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:01.793731 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:01.801329 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:01.802060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:01.802639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:01.803586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:01.804099 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:01.804552 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:01.979817 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:01.989467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:01.991261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:01.993002 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f92b111f-682b-43ba-bb83-eaed4cdec673 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1731 microversion: 2.20 time: 0.203756 Oct 06 11:14:01.993812 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 472/933] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:14:01 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:14:02.001954 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e926d56d-ef0b-47b2-8f14-53d84932aa3a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:02.003184 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e926d56d-ef0b-47b2-8f14-53d84932aa3a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:02.010693 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e926d56d-ef0b-47b2-8f14-53d84932aa3a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:02.011389 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e926d56d-ef0b-47b2-8f14-53d84932aa3a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:02.012023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e926d56d-ef0b-47b2-8f14-53d84932aa3a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:02.012920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e926d56d-ef0b-47b2-8f14-53d84932aa3a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:02.013539 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e926d56d-ef0b-47b2-8f14-53d84932aa3a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:02.014170 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e926d56d-ef0b-47b2-8f14-53d84932aa3a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:02.183211 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e926d56d-ef0b-47b2-8f14-53d84932aa3a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:02.191547 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e926d56d-ef0b-47b2-8f14-53d84932aa3a tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.194027 Oct 06 11:14:02.203778 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 462/934] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:01 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:03.024555 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:03.025291 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:03.032691 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:03.033189 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:03.033633 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:03.034352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:03.034812 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:03.035249 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:03.168544 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:03.178063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:03.179520 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:03.180740 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac79086c-7783-4b67-a125-05bb8640aa22 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1718 microversion: 2.20 time: 0.160521 Oct 06 11:14:03.181301 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 473/935] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:14:03 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:14:03.216326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c68a210-2d44-47c1-b843-148db4d5c210 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:03.216939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c68a210-2d44-47c1-b843-148db4d5c210 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:03.224075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c68a210-2d44-47c1-b843-148db4d5c210 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:03.224559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c68a210-2d44-47c1-b843-148db4d5c210 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:03.224992 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c68a210-2d44-47c1-b843-148db4d5c210 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:03.225683 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c68a210-2d44-47c1-b843-148db4d5c210 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:03.226132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c68a210-2d44-47c1-b843-148db4d5c210 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:03.226554 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c68a210-2d44-47c1-b843-148db4d5c210 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:03.374774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c68a210-2d44-47c1-b843-148db4d5c210 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:03.383188 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c68a210-2d44-47c1-b843-148db4d5c210 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.170782 Oct 06 11:14:03.383759 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 463/936] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:03 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:03.841037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-41a14701-1a02-444c-8b3f-325e8f043027 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:03.841489 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-41a14701-1a02-444c-8b3f-325e8f043027 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:03.847568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a14701-1a02-444c-8b3f-325e8f043027 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:03.848192 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a14701-1a02-444c-8b3f-325e8f043027 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:03.848532 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a14701-1a02-444c-8b3f-325e8f043027 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:03.849234 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a14701-1a02-444c-8b3f-325e8f043027 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:03.849696 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a14701-1a02-444c-8b3f-325e8f043027 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:03.850127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a14701-1a02-444c-8b3f-325e8f043027 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:03.874553 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-41a14701-1a02-444c-8b3f-325e8f043027 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/ips" status: 200 len: 142 microversion: 2.1 time: 0.036802 Oct 06 11:14:03.875126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 474/937] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Oct 6 11:14:03 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/ips => generated 142 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:14:04.407194 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b1fea03-8925-43bb-ba53-c5290476a719 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:04.407939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b1fea03-8925-43bb-ba53-c5290476a719 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:04.414651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1fea03-8925-43bb-ba53-c5290476a719 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:04.415129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1fea03-8925-43bb-ba53-c5290476a719 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:04.415562 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1fea03-8925-43bb-ba53-c5290476a719 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:04.416288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1fea03-8925-43bb-ba53-c5290476a719 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:04.416743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1fea03-8925-43bb-ba53-c5290476a719 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:04.417163 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1fea03-8925-43bb-ba53-c5290476a719 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:04.566136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-6b1fea03-8925-43bb-ba53-c5290476a719 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:04.574448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b1fea03-8925-43bb-ba53-c5290476a719 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.171820 Oct 06 11:14:04.575015 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 464/938] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:04 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:05.238779 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6225fadd-ee25-433b-9910-3e962332c405 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5468e61-1083-4cf6-9c0d-debc670c2c2d"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:14:05.241398 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6225fadd-ee25-433b-9910-3e962332c405 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:05.248386 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6225fadd-ee25-433b-9910-3e962332c405 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:05.249528 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6225fadd-ee25-433b-9910-3e962332c405 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:05.249972 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6225fadd-ee25-433b-9910-3e962332c405 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:05.250672 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6225fadd-ee25-433b-9910-3e962332c405 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:05.251136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6225fadd-ee25-433b-9910-3e962332c405 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:05.251565 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6225fadd-ee25-433b-9910-3e962332c405 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:05.508178 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:05.528750 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6225fadd-ee25-433b-9910-3e962332c405 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293699 Oct 06 11:14:05.529356 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 475/939] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:14:05 2022] POST /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:14:05.598406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e45a30db-562a-4052-b607-8309df6d3a97 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:05.599140 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e45a30db-562a-4052-b607-8309df6d3a97 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:05.606020 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e45a30db-562a-4052-b607-8309df6d3a97 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:05.606585 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e45a30db-562a-4052-b607-8309df6d3a97 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:05.607235 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e45a30db-562a-4052-b607-8309df6d3a97 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:05.608094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e45a30db-562a-4052-b607-8309df6d3a97 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:05.608860 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e45a30db-562a-4052-b607-8309df6d3a97 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:05.609378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e45a30db-562a-4052-b607-8309df6d3a97 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:05.759324 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e45a30db-562a-4052-b607-8309df6d3a97 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:05.767728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e45a30db-562a-4052-b607-8309df6d3a97 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.173166 Oct 06 11:14:05.768329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 465/940] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:05 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:06.793027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ba014f1-0cd3-43c7-9dcf-ebe5a8970c25 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:06.793740 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ba014f1-0cd3-43c7-9dcf-ebe5a8970c25 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:06.800607 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ba014f1-0cd3-43c7-9dcf-ebe5a8970c25 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:06.801099 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ba014f1-0cd3-43c7-9dcf-ebe5a8970c25 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:06.801546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ba014f1-0cd3-43c7-9dcf-ebe5a8970c25 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:06.802248 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ba014f1-0cd3-43c7-9dcf-ebe5a8970c25 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:06.802713 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ba014f1-0cd3-43c7-9dcf-ebe5a8970c25 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:06.803145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ba014f1-0cd3-43c7-9dcf-ebe5a8970c25 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:06.950297 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ba014f1-0cd3-43c7-9dcf-ebe5a8970c25 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:06.959494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ba014f1-0cd3-43c7-9dcf-ebe5a8970c25 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.171073 Oct 06 11:14:06.960087 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 476/941] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:06 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:07.982450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5c81631-ebd0-46d5-8391-35e3c32296bf tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:07.983094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5c81631-ebd0-46d5-8391-35e3c32296bf tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:07.989711 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c81631-ebd0-46d5-8391-35e3c32296bf tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:07.990245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c81631-ebd0-46d5-8391-35e3c32296bf tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:07.993003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c81631-ebd0-46d5-8391-35e3c32296bf tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:07.993959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c81631-ebd0-46d5-8391-35e3c32296bf tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:07.994455 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c81631-ebd0-46d5-8391-35e3c32296bf tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:07.994904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c81631-ebd0-46d5-8391-35e3c32296bf tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:08.138832 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5c81631-ebd0-46d5-8391-35e3c32296bf tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:08.148663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5c81631-ebd0-46d5-8391-35e3c32296bf tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.169864 Oct 06 11:14:08.149631 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 466/942] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:07 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:09.172970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-69595759-4412-46aa-bce8-490883e1ac42 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:09.173587 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-69595759-4412-46aa-bce8-490883e1ac42 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:09.176680 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:09.182187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69595759-4412-46aa-bce8-490883e1ac42 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:09.182682 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69595759-4412-46aa-bce8-490883e1ac42 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:09.183129 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69595759-4412-46aa-bce8-490883e1ac42 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:09.183864 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69595759-4412-46aa-bce8-490883e1ac42 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:09.184334 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69595759-4412-46aa-bce8-490883e1ac42 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:09.184753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69595759-4412-46aa-bce8-490883e1ac42 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:09.324368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-69595759-4412-46aa-bce8-490883e1ac42 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:09.333230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-69595759-4412-46aa-bce8-490883e1ac42 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.164183 Oct 06 11:14:09.333810 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 477/943] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:09 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:10.357032 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5619a290-2b8d-43df-b349-13482ef949b8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:10.357652 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5619a290-2b8d-43df-b349-13482ef949b8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:10.364280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5619a290-2b8d-43df-b349-13482ef949b8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:10.364767 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5619a290-2b8d-43df-b349-13482ef949b8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:10.365206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5619a290-2b8d-43df-b349-13482ef949b8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:10.365905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5619a290-2b8d-43df-b349-13482ef949b8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:10.366360 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5619a290-2b8d-43df-b349-13482ef949b8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:10.366787 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5619a290-2b8d-43df-b349-13482ef949b8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:10.516053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5619a290-2b8d-43df-b349-13482ef949b8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:10.524461 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5619a290-2b8d-43df-b349-13482ef949b8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.171340 Oct 06 11:14:10.525026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 467/944] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:10 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:11.548163 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4fd7e2c7-b1b7-4ef1-957c-7a7b0271af02 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:11.548771 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4fd7e2c7-b1b7-4ef1-957c-7a7b0271af02 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:11.555774 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fd7e2c7-b1b7-4ef1-957c-7a7b0271af02 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:11.556285 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fd7e2c7-b1b7-4ef1-957c-7a7b0271af02 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:11.556718 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fd7e2c7-b1b7-4ef1-957c-7a7b0271af02 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:11.557404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fd7e2c7-b1b7-4ef1-957c-7a7b0271af02 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:11.558413 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fd7e2c7-b1b7-4ef1-957c-7a7b0271af02 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:11.558846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fd7e2c7-b1b7-4ef1-957c-7a7b0271af02 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:11.701140 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4fd7e2c7-b1b7-4ef1-957c-7a7b0271af02 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:11.710359 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4fd7e2c7-b1b7-4ef1-957c-7a7b0271af02 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1753 microversion: 2.1 time: 0.165963 Oct 06 11:14:11.711245 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 478/945] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:11 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:12.734291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b0508aed-3cf1-47dd-8610-7e0d69ea56ba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:12.734913 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b0508aed-3cf1-47dd-8610-7e0d69ea56ba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:12.743162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0508aed-3cf1-47dd-8610-7e0d69ea56ba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:12.744193 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0508aed-3cf1-47dd-8610-7e0d69ea56ba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:12.744361 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0508aed-3cf1-47dd-8610-7e0d69ea56ba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:12.745070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0508aed-3cf1-47dd-8610-7e0d69ea56ba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:12.745526 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0508aed-3cf1-47dd-8610-7e0d69ea56ba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:12.745955 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0508aed-3cf1-47dd-8610-7e0d69ea56ba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:12.893315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b0508aed-3cf1-47dd-8610-7e0d69ea56ba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:12.902432 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b0508aed-3cf1-47dd-8610-7e0d69ea56ba tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1756 microversion: 2.1 time: 0.171978 Oct 06 11:14:12.902996 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 468/946] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:12 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:14.131306 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-30ca697c-1d49-43c7-8980-f34587e4f151 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:14.133643 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-30ca697c-1d49-43c7-8980-f34587e4f151 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:14.140043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30ca697c-1d49-43c7-8980-f34587e4f151 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:14.140534 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30ca697c-1d49-43c7-8980-f34587e4f151 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:14.140976 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30ca697c-1d49-43c7-8980-f34587e4f151 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:14.141677 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30ca697c-1d49-43c7-8980-f34587e4f151 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:14.142149 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30ca697c-1d49-43c7-8980-f34587e4f151 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:14.142599 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30ca697c-1d49-43c7-8980-f34587e4f151 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:14.178744 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-30ca697c-1d49-43c7-8980-f34587e4f151 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051471 Oct 06 11:14:14.179332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 479/947] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:14:14 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:14:14.191106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ace99143-f0a8-4122-a358-1bd8ca8e9bfd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:14.191748 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ace99143-f0a8-4122-a358-1bd8ca8e9bfd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:14.198080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ace99143-f0a8-4122-a358-1bd8ca8e9bfd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:14.198565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ace99143-f0a8-4122-a358-1bd8ca8e9bfd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:14.199004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ace99143-f0a8-4122-a358-1bd8ca8e9bfd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:14.199701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ace99143-f0a8-4122-a358-1bd8ca8e9bfd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:14.200182 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ace99143-f0a8-4122-a358-1bd8ca8e9bfd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:14.200620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ace99143-f0a8-4122-a358-1bd8ca8e9bfd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:14.217522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:14.230130 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ace99143-f0a8-4122-a358-1bd8ca8e9bfd tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments/b5468e61-1083-4cf6-9c0d-debc670c2c2d" status: 200 len: 194 microversion: 2.1 time: 0.043452 Oct 06 11:14:14.230701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 469/948] 10.222.0.52 () {58 vars in 1413 bytes} [Thu Oct 6 11:14:14 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments/b5468e61-1083-4cf6-9c0d-debc670c2c2d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:14:16.607911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5d0ce94-ca77-432f-8e3d-67e4ec2f9d90 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be5ee465-06bd-41da-8ef5-944ba577573d"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:14:16.610255 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5d0ce94-ca77-432f-8e3d-67e4ec2f9d90 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:16.617855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d0ce94-ca77-432f-8e3d-67e4ec2f9d90 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:16.618345 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d0ce94-ca77-432f-8e3d-67e4ec2f9d90 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:16.618784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d0ce94-ca77-432f-8e3d-67e4ec2f9d90 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:16.619488 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d0ce94-ca77-432f-8e3d-67e4ec2f9d90 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:16.619975 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d0ce94-ca77-432f-8e3d-67e4ec2f9d90 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:16.620405 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d0ce94-ca77-432f-8e3d-67e4ec2f9d90 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:16.891358 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5d0ce94-ca77-432f-8e3d-67e4ec2f9d90 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "POST /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287190 Oct 06 11:14:16.892383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 480/949] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:14:16 2022] POST /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:14:21.229129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1861106622", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-528045492", "security_groups": [{"name": "tempest-secgroup-smoke-2091757493"}], "networks": [{"uuid": "182bd678-df33-48e4-b3e0-b91dd41dcc22"}], "block_device_mapping_v2": [{"uuid": "099271f9-d6c0-4e34-a8e5-2dd0ef34bee0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:14:21.341532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] validate_networks() for [('182bd678-df33-48e4-b3e0-b91dd41dcc22', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:14:21.761414 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:14:21.761843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:14:21.762317 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:14:21.762728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:14:21.763140 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:14:21.772958 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:21.773443 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:21.773879 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:21.774606 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:21.775093 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:21.775523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:21.792074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Getting quotas for project 9376d8470a80416cb8e57eb650884883. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:14:21.796220 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Getting quotas for user e00353b2edab47e79578de680e4c4d1c and project 9376d8470a80416cb8e57eb650884883. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:14:21.852874 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:14:21.855006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='099271f9-d6c0-4e34-a8e5-2dd0ef34bee0',volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:14:21.984294 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [c56118c6-ea9f-4ad3-9ddc-252d6d93370b] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 11:14:22.991921 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [c56118c6-ea9f-4ad3-9ddc-252d6d93370b] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 44922. Oct 06 11:14:22.996136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-152bde30-b442-46e1-9f00-1eee8e9300b2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.770861 Oct 06 11:14:22.996798 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 470/950] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:14:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:14:23.009367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-011653bd-aa85-4ccd-89e2-a548c25fc3d7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:23.010081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-011653bd-aa85-4ccd-89e2-a548c25fc3d7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:23.012604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:23.067190 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-011653bd-aa85-4ccd-89e2-a548c25fc3d7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:23.074108 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-011653bd-aa85-4ccd-89e2-a548c25fc3d7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1088 microversion: 2.1 time: 0.069878 Oct 06 11:14:23.074676 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 481/951] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:23 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:24.096839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e3342fe4-6302-4ff8-8f60-aecbcbd9a276 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:24.097514 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e3342fe4-6302-4ff8-8f60-aecbcbd9a276 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:24.099390 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:24.104964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3342fe4-6302-4ff8-8f60-aecbcbd9a276 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:24.106316 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3342fe4-6302-4ff8-8f60-aecbcbd9a276 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:24.106316 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3342fe4-6302-4ff8-8f60-aecbcbd9a276 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:24.106605 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3342fe4-6302-4ff8-8f60-aecbcbd9a276 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:24.107059 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3342fe4-6302-4ff8-8f60-aecbcbd9a276 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:24.107684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3342fe4-6302-4ff8-8f60-aecbcbd9a276 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:24.181656 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e3342fe4-6302-4ff8-8f60-aecbcbd9a276 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:24.196964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e3342fe4-6302-4ff8-8f60-aecbcbd9a276 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1130 microversion: 2.1 time: 0.104398 Oct 06 11:14:24.197555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 471/952] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:24 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1130 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:24.443296 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5d0a518-e901-430c-8ba1-08829308b787 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:24.445596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5d0a518-e901-430c-8ba1-08829308b787 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:24.452930 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5d0a518-e901-430c-8ba1-08829308b787 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:24.453410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5d0a518-e901-430c-8ba1-08829308b787 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:24.453844 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5d0a518-e901-430c-8ba1-08829308b787 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:24.454532 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5d0a518-e901-430c-8ba1-08829308b787 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:24.455027 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5d0a518-e901-430c-8ba1-08829308b787 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:24.455460 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5d0a518-e901-430c-8ba1-08829308b787 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:24.484774 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5d0a518-e901-430c-8ba1-08829308b787 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046136 Oct 06 11:14:24.485329 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 482/953] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:14:24 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:14:24.624805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba12bfe2-a1d1-4231-9e6a-c0b314061d9a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:24.625555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba12bfe2-a1d1-4231-9e6a-c0b314061d9a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:24.632652 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba12bfe2-a1d1-4231-9e6a-c0b314061d9a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:24.633138 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba12bfe2-a1d1-4231-9e6a-c0b314061d9a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:24.633579 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba12bfe2-a1d1-4231-9e6a-c0b314061d9a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:24.634275 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba12bfe2-a1d1-4231-9e6a-c0b314061d9a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:24.634723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba12bfe2-a1d1-4231-9e6a-c0b314061d9a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:24.635175 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba12bfe2-a1d1-4231-9e6a-c0b314061d9a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:24.666000 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba12bfe2-a1d1-4231-9e6a-c0b314061d9a tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments/b5468e61-1083-4cf6-9c0d-debc670c2c2d" status: 200 len: 194 microversion: 2.1 time: 0.045196 Oct 06 11:14:24.666583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 472/954] 10.222.0.52 () {58 vars in 1413 bytes} [Thu Oct 6 11:14:24 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments/b5468e61-1083-4cf6-9c0d-debc670c2c2d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:14:24.677647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13e659cc-b668-41c4-8817-b06dc9730b20 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:24.678136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13e659cc-b668-41c4-8817-b06dc9730b20 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:24.684038 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13e659cc-b668-41c4-8817-b06dc9730b20 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:24.684525 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13e659cc-b668-41c4-8817-b06dc9730b20 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:24.684964 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13e659cc-b668-41c4-8817-b06dc9730b20 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:24.685662 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13e659cc-b668-41c4-8817-b06dc9730b20 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:24.686116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13e659cc-b668-41c4-8817-b06dc9730b20 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:24.686546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13e659cc-b668-41c4-8817-b06dc9730b20 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:24.776456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-13e659cc-b668-41c4-8817-b06dc9730b20 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lazy-loading 'services' on Instance uuid 562fb9bc-717f-4fea-9e1d-3b3637138ca8 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:14:24.853559 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13e659cc-b668-41c4-8817-b06dc9730b20 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "DELETE /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments/b5468e61-1083-4cf6-9c0d-debc670c2c2d" status: 202 len: 0 microversion: 2.1 time: 0.180218 Oct 06 11:14:24.854192 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 483/955] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:14:24 2022] DELETE /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments/b5468e61-1083-4cf6-9c0d-debc670c2c2d => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:14:25.221281 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7af628d-56ab-4b20-98de-9d8f4bdd46b5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:25.221855 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7af628d-56ab-4b20-98de-9d8f4bdd46b5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:25.229265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7af628d-56ab-4b20-98de-9d8f4bdd46b5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:25.229759 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7af628d-56ab-4b20-98de-9d8f4bdd46b5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:25.230203 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7af628d-56ab-4b20-98de-9d8f4bdd46b5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:25.230910 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7af628d-56ab-4b20-98de-9d8f4bdd46b5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:25.231370 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7af628d-56ab-4b20-98de-9d8f4bdd46b5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:25.231805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7af628d-56ab-4b20-98de-9d8f4bdd46b5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:25.294952 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7af628d-56ab-4b20-98de-9d8f4bdd46b5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:25.303024 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7af628d-56ab-4b20-98de-9d8f4bdd46b5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1204 microversion: 2.1 time: 0.086081 Oct 06 11:14:25.303594 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 473/956] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:25 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:26.193377 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-88d4b5fd-cadc-4880-ba75-17b0b05f9450 req-5e2b1dbe-bd6f-4757-8257-5fbe72ddd6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6e0b3e-d553-4434-8a4f-b70e545a33f8", "tag": "b4073667-1fd2-4402-b6cb-c6a7057072a4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:14:26.203079 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-88d4b5fd-cadc-4880-ba75-17b0b05f9450 req-5e2b1dbe-bd6f-4757-8257-5fbe72ddd6c2 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:26.203638 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-88d4b5fd-cadc-4880-ba75-17b0b05f9450 req-5e2b1dbe-bd6f-4757-8257-5fbe72ddd6c2 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:26.204104 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-88d4b5fd-cadc-4880-ba75-17b0b05f9450 req-5e2b1dbe-bd6f-4757-8257-5fbe72ddd6c2 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:26.214644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-88d4b5fd-cadc-4880-ba75-17b0b05f9450 req-5e2b1dbe-bd6f-4757-8257-5fbe72ddd6c2 service nova] Creating event network-changed:b4073667-1fd2-4402-b6cb-c6a7057072a4 for instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 on hv-cinder-86020 Oct 06 11:14:26.219616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-88d4b5fd-cadc-4880-ba75-17b0b05f9450 req-5e2b1dbe-bd6f-4757-8257-5fbe72ddd6c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030819 Oct 06 11:14:26.220254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 484/957] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:14:26.326111 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b38ceecf-ae46-4059-a912-9e05d5b9e5fa tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:26.326722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b38ceecf-ae46-4059-a912-9e05d5b9e5fa tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:26.333268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38ceecf-ae46-4059-a912-9e05d5b9e5fa tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:26.333743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38ceecf-ae46-4059-a912-9e05d5b9e5fa tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:26.334174 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38ceecf-ae46-4059-a912-9e05d5b9e5fa tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:26.334855 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38ceecf-ae46-4059-a912-9e05d5b9e5fa tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:26.335304 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38ceecf-ae46-4059-a912-9e05d5b9e5fa tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:26.335721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38ceecf-ae46-4059-a912-9e05d5b9e5fa tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:26.463265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b38ceecf-ae46-4059-a912-9e05d5b9e5fa tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:26.471080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b38ceecf-ae46-4059-a912-9e05d5b9e5fa tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.148808 Oct 06 11:14:26.471646 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 474/958] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:26 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:27.035353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a1dae29c-ac15-4f57-a8c3-73b1cdbd4d25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:27.036073 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a1dae29c-ac15-4f57-a8c3-73b1cdbd4d25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:27.042329 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1dae29c-ac15-4f57-a8c3-73b1cdbd4d25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:27.042778 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1dae29c-ac15-4f57-a8c3-73b1cdbd4d25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:27.043210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1dae29c-ac15-4f57-a8c3-73b1cdbd4d25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:27.043945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1dae29c-ac15-4f57-a8c3-73b1cdbd4d25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:27.044406 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1dae29c-ac15-4f57-a8c3-73b1cdbd4d25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:27.044836 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1dae29c-ac15-4f57-a8c3-73b1cdbd4d25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:27.074609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a1dae29c-ac15-4f57-a8c3-73b1cdbd4d25 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments/be5ee465-06bd-41da-8ef5-944ba577573d" status: 200 len: 194 microversion: 2.1 time: 0.043937 Oct 06 11:14:27.075529 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 485/959] 10.222.0.52 () {58 vars in 1413 bytes} [Thu Oct 6 11:14:27 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments/be5ee465-06bd-41da-8ef5-944ba577573d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:14:27.086617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d09ec30b-4358-4c6a-85bc-16978c37cc98 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:27.087117 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d09ec30b-4358-4c6a-85bc-16978c37cc98 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:27.093270 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d09ec30b-4358-4c6a-85bc-16978c37cc98 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:27.093770 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d09ec30b-4358-4c6a-85bc-16978c37cc98 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:27.094220 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d09ec30b-4358-4c6a-85bc-16978c37cc98 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:27.094925 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d09ec30b-4358-4c6a-85bc-16978c37cc98 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:27.095677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d09ec30b-4358-4c6a-85bc-16978c37cc98 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:27.096365 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d09ec30b-4358-4c6a-85bc-16978c37cc98 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:27.178391 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-d09ec30b-4358-4c6a-85bc-16978c37cc98 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lazy-loading 'services' on Instance uuid 562fb9bc-717f-4fea-9e1d-3b3637138ca8 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:14:27.252266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d09ec30b-4358-4c6a-85bc-16978c37cc98 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "DELETE /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments/be5ee465-06bd-41da-8ef5-944ba577573d" status: 202 len: 0 microversion: 2.1 time: 0.170074 Oct 06 11:14:27.252872 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 475/960] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:14:27 2022] DELETE /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments/be5ee465-06bd-41da-8ef5-944ba577573d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:14:27.494647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2d6bb95e-7449-4b72-b13d-e9c86abcdbda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:27.495191 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2d6bb95e-7449-4b72-b13d-e9c86abcdbda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:27.501579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d6bb95e-7449-4b72-b13d-e9c86abcdbda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:27.502063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d6bb95e-7449-4b72-b13d-e9c86abcdbda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:27.502502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d6bb95e-7449-4b72-b13d-e9c86abcdbda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:27.503230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d6bb95e-7449-4b72-b13d-e9c86abcdbda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:27.503689 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d6bb95e-7449-4b72-b13d-e9c86abcdbda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:27.504821 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d6bb95e-7449-4b72-b13d-e9c86abcdbda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:27.638711 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2d6bb95e-7449-4b72-b13d-e9c86abcdbda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:27.647734 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2d6bb95e-7449-4b72-b13d-e9c86abcdbda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.156810 Oct 06 11:14:27.648331 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 486/961] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:27 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:28.672742 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b7bfc0a9-62ff-491d-a996-9ed94ce1b56c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:28.673578 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b7bfc0a9-62ff-491d-a996-9ed94ce1b56c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:28.680930 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7bfc0a9-62ff-491d-a996-9ed94ce1b56c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:28.681425 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7bfc0a9-62ff-491d-a996-9ed94ce1b56c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:28.681863 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7bfc0a9-62ff-491d-a996-9ed94ce1b56c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:28.682598 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7bfc0a9-62ff-491d-a996-9ed94ce1b56c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:28.683039 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7bfc0a9-62ff-491d-a996-9ed94ce1b56c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:28.683468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7bfc0a9-62ff-491d-a996-9ed94ce1b56c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:28.823950 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b7bfc0a9-62ff-491d-a996-9ed94ce1b56c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:28.832587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b7bfc0a9-62ff-491d-a996-9ed94ce1b56c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.164801 Oct 06 11:14:28.833150 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 476/962] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:28 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:29.496565 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42b65d34-bd11-4a34-8054-fda9b04e5f05 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:29.498824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42b65d34-bd11-4a34-8054-fda9b04e5f05 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:29.506201 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42b65d34-bd11-4a34-8054-fda9b04e5f05 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:29.506696 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42b65d34-bd11-4a34-8054-fda9b04e5f05 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:29.507144 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42b65d34-bd11-4a34-8054-fda9b04e5f05 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:29.507907 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42b65d34-bd11-4a34-8054-fda9b04e5f05 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:29.508374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42b65d34-bd11-4a34-8054-fda9b04e5f05 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:29.508808 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42b65d34-bd11-4a34-8054-fda9b04e5f05 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:29.539031 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42b65d34-bd11-4a34-8054-fda9b04e5f05 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046423 Oct 06 11:14:29.539580 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 487/963] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:14:29 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 11:14:29.655878 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-528c57fc-cdc1-4b49-8a11-f8093cb304de tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:29.658187 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-528c57fc-cdc1-4b49-8a11-f8093cb304de tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:29.664189 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-528c57fc-cdc1-4b49-8a11-f8093cb304de tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:29.664670 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-528c57fc-cdc1-4b49-8a11-f8093cb304de tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:29.665106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-528c57fc-cdc1-4b49-8a11-f8093cb304de tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:29.665797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-528c57fc-cdc1-4b49-8a11-f8093cb304de tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:29.666248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-528c57fc-cdc1-4b49-8a11-f8093cb304de tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:29.666672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-528c57fc-cdc1-4b49-8a11-f8093cb304de tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:29.696598 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-528c57fc-cdc1-4b49-8a11-f8093cb304de tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045679 Oct 06 11:14:29.697211 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 477/964] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:14:29 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 11:14:29.758649 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6abb4487-6dac-4557-ba4c-4a12b6e93627 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:29.759143 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6abb4487-6dac-4557-ba4c-4a12b6e93627 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:29.764940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6abb4487-6dac-4557-ba4c-4a12b6e93627 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:29.765420 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6abb4487-6dac-4557-ba4c-4a12b6e93627 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:29.765863 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6abb4487-6dac-4557-ba4c-4a12b6e93627 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:29.766549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6abb4487-6dac-4557-ba4c-4a12b6e93627 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:29.767005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6abb4487-6dac-4557-ba4c-4a12b6e93627 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:29.767426 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6abb4487-6dac-4557-ba4c-4a12b6e93627 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:29.791916 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6abb4487-6dac-4557-ba4c-4a12b6e93627 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:14:29.857324 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-677b3515-e666-4345-9b57-327cec4bdc71 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:29.857963 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-677b3515-e666-4345-9b57-327cec4bdc71 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:29.865727 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-677b3515-e666-4345-9b57-327cec4bdc71 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:29.866616 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-677b3515-e666-4345-9b57-327cec4bdc71 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:29.867232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-677b3515-e666-4345-9b57-327cec4bdc71 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:29.868154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-677b3515-e666-4345-9b57-327cec4bdc71 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:29.868824 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-677b3515-e666-4345-9b57-327cec4bdc71 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:29.869223 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-677b3515-e666-4345-9b57-327cec4bdc71 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:29.873059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6abb4487-6dac-4557-ba4c-4a12b6e93627 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "DELETE /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 204 len: 0 microversion: 2.1 time: 0.117884 Oct 06 11:14:29.874220 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 488/965] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:14:29 2022] DELETE /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:14:29.885779 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e85d166f-7fcd-4c10-bea7-4fe7fad3bab1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:29.886873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e85d166f-7fcd-4c10-bea7-4fe7fad3bab1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:29.894647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85d166f-7fcd-4c10-bea7-4fe7fad3bab1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:29.895354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85d166f-7fcd-4c10-bea7-4fe7fad3bab1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:29.895989 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85d166f-7fcd-4c10-bea7-4fe7fad3bab1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:29.897169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85d166f-7fcd-4c10-bea7-4fe7fad3bab1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:29.898129 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85d166f-7fcd-4c10-bea7-4fe7fad3bab1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:29.898758 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85d166f-7fcd-4c10-bea7-4fe7fad3bab1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:30.013446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-677b3515-e666-4345-9b57-327cec4bdc71 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:30.021118 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-677b3515-e666-4345-9b57-327cec4bdc71 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.168852 Oct 06 11:14:30.021687 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 478/966] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:29 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:30.036756 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e85d166f-7fcd-4c10-bea7-4fe7fad3bab1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:30.044524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e85d166f-7fcd-4c10-bea7-4fe7fad3bab1 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1670 microversion: 2.1 time: 0.165922 Oct 06 11:14:30.045084 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 489/967] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:29 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:14:31.044377 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d3bbb012-855a-451c-9510-e847745c3db8 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:31.045174 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d3bbb012-855a-451c-9510-e847745c3db8 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:31.052800 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bbb012-855a-451c-9510-e847745c3db8 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:31.053368 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bbb012-855a-451c-9510-e847745c3db8 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:31.053805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bbb012-855a-451c-9510-e847745c3db8 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:31.054500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bbb012-855a-451c-9510-e847745c3db8 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:31.054950 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bbb012-855a-451c-9510-e847745c3db8 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:31.055376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3bbb012-855a-451c-9510-e847745c3db8 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:31.069953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1699f0f-15f3-4bde-a201-29601bcac171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:31.071533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1699f0f-15f3-4bde-a201-29601bcac171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:31.077927 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1699f0f-15f3-4bde-a201-29601bcac171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:31.078734 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1699f0f-15f3-4bde-a201-29601bcac171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:31.079376 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1699f0f-15f3-4bde-a201-29601bcac171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:31.080281 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1699f0f-15f3-4bde-a201-29601bcac171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:31.080907 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1699f0f-15f3-4bde-a201-29601bcac171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:31.081598 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1699f0f-15f3-4bde-a201-29601bcac171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:31.101952 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:31.190243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d3bbb012-855a-451c-9510-e847745c3db8 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:31.198514 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d3bbb012-855a-451c-9510-e847745c3db8 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.157959 Oct 06 11:14:31.199086 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 479/968] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:31 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:31.220963 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1699f0f-15f3-4bde-a201-29601bcac171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:31.229483 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1699f0f-15f3-4bde-a201-29601bcac171 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1670 microversion: 2.1 time: 0.164926 Oct 06 11:14:31.230047 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 490/969] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:31 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:14:32.221031 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ff768a07-fe60-4638-9161-c92031d31d3b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:32.221671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ff768a07-fe60-4638-9161-c92031d31d3b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:32.223641 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:32.224487 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:32.230803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff768a07-fe60-4638-9161-c92031d31d3b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:32.231287 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff768a07-fe60-4638-9161-c92031d31d3b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:32.231719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff768a07-fe60-4638-9161-c92031d31d3b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:32.232442 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff768a07-fe60-4638-9161-c92031d31d3b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:32.232893 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff768a07-fe60-4638-9161-c92031d31d3b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:32.233562 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff768a07-fe60-4638-9161-c92031d31d3b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:32.253399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f47a0cc-7133-464d-a4f9-62ef545a838b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:32.254820 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f47a0cc-7133-464d-a4f9-62ef545a838b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:32.261198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f47a0cc-7133-464d-a4f9-62ef545a838b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:32.261794 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f47a0cc-7133-464d-a4f9-62ef545a838b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:32.262243 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f47a0cc-7133-464d-a4f9-62ef545a838b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:32.262951 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f47a0cc-7133-464d-a4f9-62ef545a838b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:32.263425 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f47a0cc-7133-464d-a4f9-62ef545a838b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:32.263872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f47a0cc-7133-464d-a4f9-62ef545a838b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:32.375656 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ff768a07-fe60-4638-9161-c92031d31d3b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:32.384663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ff768a07-fe60-4638-9161-c92031d31d3b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.167561 Oct 06 11:14:32.399483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 480/970] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:32 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:32.471429 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f47a0cc-7133-464d-a4f9-62ef545a838b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:32.479698 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f47a0cc-7133-464d-a4f9-62ef545a838b tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1670 microversion: 2.1 time: 0.230147 Oct 06 11:14:32.480308 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 491/971] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:32 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1670 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:33.079257 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6a502007-364a-4f31-a659-545cb61da9fe req-28cafb7e-de4c-4cfc-be66-c36bef892dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562fb9bc-717f-4fea-9e1d-3b3637138ca8", "name": "network-vif-deleted", "tag": "a1ce9ffa-2969-4b3f-8579-49451048adf4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:14:33.086241 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 11:14:33.086504 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Thu Oct 6 11:14:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Oct 06 11:14:33.092239 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6a502007-364a-4f31-a659-545cb61da9fe req-28cafb7e-de4c-4cfc-be66-c36bef892dd2 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:33.092712 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6a502007-364a-4f31-a659-545cb61da9fe req-28cafb7e-de4c-4cfc-be66-c36bef892dd2 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:33.093136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6a502007-364a-4f31-a659-545cb61da9fe req-28cafb7e-de4c-4cfc-be66-c36bef892dd2 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:33.121540 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6a502007-364a-4f31-a659-545cb61da9fe req-28cafb7e-de4c-4cfc-be66-c36bef892dd2 service nova] Creating event network-vif-deleted:a1ce9ffa-2969-4b3f-8579-49451048adf4 for instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 on hv-cinder-86020 Oct 06 11:14:33.127058 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6a502007-364a-4f31-a659-545cb61da9fe req-28cafb7e-de4c-4cfc-be66-c36bef892dd2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051449 Oct 06 11:14:33.127654 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 481/972] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:14:33.408390 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-988dc0fc-7866-4851-8447-362bd0cf8e0b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:33.409009 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-988dc0fc-7866-4851-8447-362bd0cf8e0b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:33.411735 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:33.417876 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-988dc0fc-7866-4851-8447-362bd0cf8e0b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:33.418368 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-988dc0fc-7866-4851-8447-362bd0cf8e0b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:33.418807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-988dc0fc-7866-4851-8447-362bd0cf8e0b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:33.419519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-988dc0fc-7866-4851-8447-362bd0cf8e0b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:33.420008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-988dc0fc-7866-4851-8447-362bd0cf8e0b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:33.420441 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-988dc0fc-7866-4851-8447-362bd0cf8e0b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:33.505129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:33.505844 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:33.512070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:33.512718 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:33.513005 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:33.514021 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:33.514305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:33.514735 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:33.551661 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:33.552456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:33.552904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:33.553428 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lazy-loading 'fault' on Instance uuid 562fb9bc-717f-4fea-9e1d-3b3637138ca8 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:14:33.560374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-988dc0fc-7866-4851-8447-362bd0cf8e0b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:33.570303 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-988dc0fc-7866-4851-8447-362bd0cf8e0b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.165644 Oct 06 11:14:33.570896 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 492/973] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:33 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:33.596931 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:33.605321 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82a54d31-4e20-4f67-87be-6d40f4e70582 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1327 microversion: 2.1 time: 0.105371 Oct 06 11:14:33.605914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 482/974] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:33 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:14:34.593684 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3daf2f98-c1b8-45f7-b4c6-49950f8c5d95 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:34.594304 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3daf2f98-c1b8-45f7-b4c6-49950f8c5d95 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:34.600831 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daf2f98-c1b8-45f7-b4c6-49950f8c5d95 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:34.601322 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daf2f98-c1b8-45f7-b4c6-49950f8c5d95 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:34.601778 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daf2f98-c1b8-45f7-b4c6-49950f8c5d95 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:34.602482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daf2f98-c1b8-45f7-b4c6-49950f8c5d95 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:34.602946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daf2f98-c1b8-45f7-b4c6-49950f8c5d95 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:34.603380 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daf2f98-c1b8-45f7-b4c6-49950f8c5d95 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:34.630473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:34.631084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:34.637669 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:34.638167 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:34.638699 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:34.639407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:34.639896 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:34.640543 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:34.672505 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:34.672912 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:34.673350 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:34.673799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lazy-loading 'fault' on Instance uuid 562fb9bc-717f-4fea-9e1d-3b3637138ca8 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:14:34.714094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb1115590ac45fdbcdc6d3f52aa6921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9bfd4947d045cf831f1a60bf91f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:34.721799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7efab34-c03c-48c7-b418-e1900ce5b973 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 200 len: 1327 microversion: 2.1 time: 0.095785 Oct 06 11:14:34.722622 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 483/975] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:34 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:14:34.733765 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3daf2f98-c1b8-45f7-b4c6-49950f8c5d95 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:34.741581 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3daf2f98-c1b8-45f7-b4c6-49950f8c5d95 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.151785 Oct 06 11:14:34.742153 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 493/976] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:34 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:35.744944 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:35.745564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:35.751995 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:35.752488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:35.752951 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:35.753656 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:35.754284 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:35.754719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:35.764583 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-28132f10-4181-4348-9736-504bbf2e0a04 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:35.765222 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-28132f10-4181-4348-9736-504bbf2e0a04 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:35.768040 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] HTTP exception thrown: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Request method failure captured: Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 HTTP/1.1 Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYr9286ddhT2GiULSW1xDw111Fh_IAZttVLQN30Bz8q-VQOpjfXyvDUqHu3s_WG0Cj_WPQ2HB7DRQIl5KNc0jHz6Sop9Fgb4nwQSwBDZceh849x5wxvbEmG-Zy39b-hfwWjuyXoOmZCgQ8yI5wd1ttREzJrHmHTOkcwH5RNpBddppI Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:14:35.770359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 1bb1115590ac45fdbcdc6d3f52aa6921 Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:35.772108 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '562fb9bc-717f-4fea-9e1d-3b3637138ca8'} Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:35.773358 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:35.774927 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:35.776354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Returning 404 to user: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:35.776354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4dcec662-6ec0-46f1-872b-c0f83770e421 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 404 len: 111 microversion: 2.1 time: 0.030837 Oct 06 11:14:35.776518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28132f10-4181-4348-9736-504bbf2e0a04 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:35.776518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28132f10-4181-4348-9736-504bbf2e0a04 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:35.776518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28132f10-4181-4348-9736-504bbf2e0a04 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:35.776518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28132f10-4181-4348-9736-504bbf2e0a04 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:35.776865 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28132f10-4181-4348-9736-504bbf2e0a04 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:35.776865 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28132f10-4181-4348-9736-504bbf2e0a04 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:35.777047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 484/977] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:35 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:14:35.782518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-850319c2-5011-4793-9b5b-8dc3f44fe132 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '.version_select at 0x7f92a6e40e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:35.806004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-850319c2-5011-4793-9b5b-8dc3f44fe132 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-695847567" status: 202 len: 0 microversion: 2.1 time: 0.028822 Oct 06 11:14:35.806579 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 485/978] 10.222.0.52 () {58 vars in 1218 bytes} [Thu Oct 6 11:14:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-695847567 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:14:35.915863 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-28132f10-4181-4348-9736-504bbf2e0a04 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:35.923559 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-28132f10-4181-4348-9736-504bbf2e0a04 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.162754 Oct 06 11:14:35.924164 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 494/979] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:35 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:14:36.948874 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-55122e4e-31ec-41f0-af2f-6b286e2529e6 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:36.949489 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-55122e4e-31ec-41f0-af2f-6b286e2529e6 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:36.956222 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55122e4e-31ec-41f0-af2f-6b286e2529e6 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:36.956710 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55122e4e-31ec-41f0-af2f-6b286e2529e6 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:36.957709 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55122e4e-31ec-41f0-af2f-6b286e2529e6 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:36.958404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55122e4e-31ec-41f0-af2f-6b286e2529e6 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:36.958853 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55122e4e-31ec-41f0-af2f-6b286e2529e6 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:36.959274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55122e4e-31ec-41f0-af2f-6b286e2529e6 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:37.093334 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-55122e4e-31ec-41f0-af2f-6b286e2529e6 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:37.102284 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-55122e4e-31ec-41f0-af2f-6b286e2529e6 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.157750 Oct 06 11:14:37.102869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 486/980] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:36 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:38.125664 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4dcc36da-c81d-43e2-bda3-37617f25bd2d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:38.126282 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4dcc36da-c81d-43e2-bda3-37617f25bd2d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:38.132884 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcc36da-c81d-43e2-bda3-37617f25bd2d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:38.133367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcc36da-c81d-43e2-bda3-37617f25bd2d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:38.133805 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcc36da-c81d-43e2-bda3-37617f25bd2d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:38.134498 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcc36da-c81d-43e2-bda3-37617f25bd2d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:38.134953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcc36da-c81d-43e2-bda3-37617f25bd2d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:38.135388 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcc36da-c81d-43e2-bda3-37617f25bd2d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:38.263939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4dcc36da-c81d-43e2-bda3-37617f25bd2d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:38.272733 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4dcc36da-c81d-43e2-bda3-37617f25bd2d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.150634 Oct 06 11:14:38.273296 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 495/981] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:38 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:38.692590 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:38.693103 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:38.699488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:38.700020 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:38.700468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:38.701170 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:38.701633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:38.702074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:38.716043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] HTTP exception thrown: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Request method failure captured: Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 HTTP/1.1 Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYr9286ddhT2GiULSW1xDw111Fh_IAZttVLQN30Bz8q-VQOpjfXyvDUqHu3s_WG0Cj_WPQ2HB7DRQIl5KNc0jHz6Sop9Fgb4nwQSwBDZceh849x5wxvbEmG-Zy39b-hfwWjuyXoOmZCgQ8yI5wd1ttREzJrHmHTOkcwH5RNpBddppI Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:14:38.717587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 1bb1115590ac45fdbcdc6d3f52aa6921 Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:38.719144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '562fb9bc-717f-4fea-9e1d-3b3637138ca8'} Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:38.720066 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:38.721532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:38.723666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Returning 404 to user: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:38.723666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e2a659f3-f5c6-4ca1-be47-bf4f71b3646c tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "DELETE /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 404 len: 111 microversion: 2.1 time: 0.030425 Oct 06 11:14:38.723666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 487/982] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:14:38 2022] DELETE /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:14:38.728691 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:38.729311 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 562fb9bc-717f-4fea-9e1d-3b3637138ca8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:38.735398 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:38.735934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:38.736386 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:38.737126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:38.737625 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:38.738121 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:38.751424 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] HTTP exception thrown: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Request method failure captured: Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 HTTP/1.1 Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrYr9286ddhT2GiULSW1xDw111Fh_IAZttVLQN30Bz8q-VQOpjfXyvDUqHu3s_WG0Cj_WPQ2HB7DRQIl5KNc0jHz6Sop9Fgb4nwQSwBDZceh849x5wxvbEmG-Zy39b-hfwWjuyXoOmZCgQ8yI5wd1ttREzJrHmHTOkcwH5RNpBddppI Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:14:38.753097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 1bb1115590ac45fdbcdc6d3f52aa6921 Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:38.755072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '562fb9bc-717f-4fea-9e1d-3b3637138ca8'} Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:38.756000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. Oct 06 11:14:38.757480 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:38.758695 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Returning 404 to user: Instance 562fb9bc-717f-4fea-9e1d-3b3637138ca8 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:38.758695 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4458ba1-4715-4137-86da-a8e2936c4aaf tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8" status: 404 len: 111 microversion: 2.1 time: 0.029869 Oct 06 11:14:38.758695 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 496/983] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:38 2022] GET /compute/v2.1/servers/562fb9bc-717f-4fea-9e1d-3b3637138ca8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:14:38.989912 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6a4ab081-eb9a-4ba7-b0ae-6dc219200746 req-85d1fa71-91ca-491a-b632-b91da64b719f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6e0b3e-d553-4434-8a4f-b70e545a33f8", "name": "network-vif-plugged", "status": "completed", "tag": "b4073667-1fd2-4402-b6cb-c6a7057072a4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:14:38.999217 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6a4ab081-eb9a-4ba7-b0ae-6dc219200746 req-85d1fa71-91ca-491a-b632-b91da64b719f service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:38.999620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6a4ab081-eb9a-4ba7-b0ae-6dc219200746 req-85d1fa71-91ca-491a-b632-b91da64b719f service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:39.000109 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6a4ab081-eb9a-4ba7-b0ae-6dc219200746 req-85d1fa71-91ca-491a-b632-b91da64b719f service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:39.011762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6a4ab081-eb9a-4ba7-b0ae-6dc219200746 req-85d1fa71-91ca-491a-b632-b91da64b719f service nova] Creating event network-vif-plugged:b4073667-1fd2-4402-b6cb-c6a7057072a4 for instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 on hv-cinder-86020 Oct 06 11:14:39.016811 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6a4ab081-eb9a-4ba7-b0ae-6dc219200746 req-85d1fa71-91ca-491a-b632-b91da64b719f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030770 Oct 06 11:14:39.017404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 488/984] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:14:39.295621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eff9cc75-2c29-4abb-8437-80ec1cb8157b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:39.296269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eff9cc75-2c29-4abb-8437-80ec1cb8157b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:39.303318 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff9cc75-2c29-4abb-8437-80ec1cb8157b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:39.303802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff9cc75-2c29-4abb-8437-80ec1cb8157b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:39.304262 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff9cc75-2c29-4abb-8437-80ec1cb8157b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:39.304965 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff9cc75-2c29-4abb-8437-80ec1cb8157b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:39.305414 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff9cc75-2c29-4abb-8437-80ec1cb8157b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:39.305840 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eff9cc75-2c29-4abb-8437-80ec1cb8157b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:39.437061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eff9cc75-2c29-4abb-8437-80ec1cb8157b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:39.445466 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eff9cc75-2c29-4abb-8437-80ec1cb8157b tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.153757 Oct 06 11:14:39.446031 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 497/985] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:39 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:39.895738 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:39.896387 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:39.902712 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:39.903233 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:39.903682 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:39.904412 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:39.904884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:39.905321 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:39.909300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:39.920173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] HTTP exception thrown: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Request method failure captured: Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c HTTP/1.1 Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYr9286ddhT2GiULSW1xDw111Fh_IAZttVLQN30Bz8q-VQOpjfXyvDUqHu3s_WG0Cj_WPQ2HB7DRQIl5KNc0jHz6Sop9Fgb4nwQSwBDZceh849x5wxvbEmG-Zy39b-hfwWjuyXoOmZCgQ8yI5wd1ttREzJrHmHTOkcwH5RNpBddppI Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:14:39.921943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 1bb1115590ac45fdbcdc6d3f52aa6921 Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:14:39.923416 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '3eb86039-b159-435a-b022-4396a59b657c'} Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:39.924204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:14:39.925465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:39.927232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Returning 404 to user: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:39.927232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6517349b-8d3f-4cf2-a0e8-8f6189d658a0 tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 404 len: 111 microversion: 2.1 time: 0.032469 Oct 06 11:14:39.927232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 489/986] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:14:39 2022] DELETE /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:14:39.932497 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:39.933119 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] [instance: 3eb86039-b159-435a-b022-4396a59b657c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:39.939003 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:39.939496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:39.939969 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:39.940680 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:39.941251 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:39.941684 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:39.954687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] HTTP exception thrown: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Request method failure captured: Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c HTTP/1.1 Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrYr9286ddhT2GiULSW1xDw111Fh_IAZttVLQN30Bz8q-VQOpjfXyvDUqHu3s_WG0Cj_WPQ2HB7DRQIl5KNc0jHz6Sop9Fgb4nwQSwBDZceh849x5wxvbEmG-Zy39b-hfwWjuyXoOmZCgQ8yI5wd1ttREzJrHmHTOkcwH5RNpBddppI Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:14:39.956231 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c9bfd4947d045cf831f1a60bf91f389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 8c9bfd4947d045cf831f1a60bf91f389 Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568064328 Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 1bb1115590ac45fdbcdc6d3f52aa6921 Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeTestJSON-1568064328-project Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:14:39.958063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '3eb86039-b159-435a-b022-4396a59b657c'} Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:39.958998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. Oct 06 11:14:39.960470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:39.961810 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] Returning 404 to user: Instance 3eb86039-b159-435a-b022-4396a59b657c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:39.961810 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-02813b65-a0f3-40ae-b648-e8896024acba tempest-AttachVolumeTestJSON-1568064328 tempest-AttachVolumeTestJSON-1568064328-project] 10.222.0.52 "GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c" status: 404 len: 111 microversion: 2.1 time: 0.028990 Oct 06 11:14:39.961810 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 498/987] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:39 2022] GET /compute/v2.1/servers/3eb86039-b159-435a-b022-4396a59b657c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:14:40.468514 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08cb96c8-b27a-4151-a789-fcf05f2adc27 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:40.469168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08cb96c8-b27a-4151-a789-fcf05f2adc27 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:40.476542 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08cb96c8-b27a-4151-a789-fcf05f2adc27 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:40.477041 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08cb96c8-b27a-4151-a789-fcf05f2adc27 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:40.477485 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08cb96c8-b27a-4151-a789-fcf05f2adc27 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:40.478201 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08cb96c8-b27a-4151-a789-fcf05f2adc27 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:40.478656 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08cb96c8-b27a-4151-a789-fcf05f2adc27 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:40.479087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08cb96c8-b27a-4151-a789-fcf05f2adc27 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:40.755359 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-08cb96c8-b27a-4151-a789-fcf05f2adc27 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:40.763057 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08cb96c8-b27a-4151-a789-fcf05f2adc27 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1260 microversion: 2.1 time: 0.298460 Oct 06 11:14:40.763627 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 490/988] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:40 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1260 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:41.786838 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82ac3575-57eb-445c-93d4-ff3d65481a55 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:41.787455 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82ac3575-57eb-445c-93d4-ff3d65481a55 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:41.807217 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82ac3575-57eb-445c-93d4-ff3d65481a55 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:41.807709 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82ac3575-57eb-445c-93d4-ff3d65481a55 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:41.808180 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82ac3575-57eb-445c-93d4-ff3d65481a55 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:41.808894 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82ac3575-57eb-445c-93d4-ff3d65481a55 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:41.809354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82ac3575-57eb-445c-93d4-ff3d65481a55 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:41.809776 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82ac3575-57eb-445c-93d4-ff3d65481a55 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:41.998268 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-82ac3575-57eb-445c-93d4-ff3d65481a55 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:42.007749 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82ac3575-57eb-445c-93d4-ff3d65481a55 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1444 microversion: 2.1 time: 0.224836 Oct 06 11:14:42.008360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 499/989] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:41 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1444 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:14:42.031450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-634eb8b7-3a32-4b69-8248-aed3b77b6af7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:42.032145 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-634eb8b7-3a32-4b69-8248-aed3b77b6af7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:14:42.039202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-634eb8b7-3a32-4b69-8248-aed3b77b6af7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:42.039698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-634eb8b7-3a32-4b69-8248-aed3b77b6af7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:42.040614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-634eb8b7-3a32-4b69-8248-aed3b77b6af7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:42.040886 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-634eb8b7-3a32-4b69-8248-aed3b77b6af7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:42.041346 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-634eb8b7-3a32-4b69-8248-aed3b77b6af7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:42.041946 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-634eb8b7-3a32-4b69-8248-aed3b77b6af7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:42.245551 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-634eb8b7-3a32-4b69-8248-aed3b77b6af7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:14:42.258522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-634eb8b7-3a32-4b69-8248-aed3b77b6af7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1444 microversion: 2.1 time: 0.231096 Oct 06 11:14:42.259112 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 491/990] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:14:42 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1444 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:14:44.542068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-df2a7111-55f9-4565-95ab-500643cc25d4 req-decb8e47-7f04-4c88-9a6a-fcc6c4be33b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6e0b3e-d553-4434-8a4f-b70e545a33f8", "tag": "b4073667-1fd2-4402-b6cb-c6a7057072a4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:14:44.556868 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df2a7111-55f9-4565-95ab-500643cc25d4 req-decb8e47-7f04-4c88-9a6a-fcc6c4be33b3 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:14:44.557638 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df2a7111-55f9-4565-95ab-500643cc25d4 req-decb8e47-7f04-4c88-9a6a-fcc6c4be33b3 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:14:44.558305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df2a7111-55f9-4565-95ab-500643cc25d4 req-decb8e47-7f04-4c88-9a6a-fcc6c4be33b3 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:14:44.572468 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-df2a7111-55f9-4565-95ab-500643cc25d4 req-decb8e47-7f04-4c88-9a6a-fcc6c4be33b3 service nova] Creating event network-changed:b4073667-1fd2-4402-b6cb-c6a7057072a4 for instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 on hv-cinder-86020 Oct 06 11:14:44.577830 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-df2a7111-55f9-4565-95ab-500643cc25d4 req-decb8e47-7f04-4c88-9a6a-fcc6c4be33b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039511 Oct 06 11:14:44.579127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 500/991] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:14:44.891084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6801efde-d18d-42e8-a7b7-cd95af4e133c tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Action: 'create', calling method: .version_select at 0x7f92a6e40040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-558078160", "metadata": {"Type": "work"}}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6801efde-d18d-42e8-a7b7-cd95af4e133c tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Request method failure captured: Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 121 Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrikUH1iQipKiOcHPsNe28W_wMOujg0ucbYmhlHL6dbdXrfAbjcGZbMWKb5g4RaIrIG2FyE5Hq1zN1XuqM8Jd0yfXw8ua6H3APjss2lOKpE-03WPJKY5SKhZKw_7KkXIYY74uXWg8AFJ2JR0XvbaCVzqiXBmnICVuaXil_b5CVttwoA Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:14:44.913565 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 075061bd2a174dc5823d04f292c9de7b Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-558078160", "metadata": {"Type": "work"}}} Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: Oct 06 11:14:44.915342 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-558078160', 'metadata': {'Type': 'work'}}}} Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi '#$%' Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:44.916311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 11:14:44.917701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 11:14:44.921050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 11:14:44.921050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.921050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6801efde-d18d-42e8-a7b7-cd95af4e133c tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:44.921050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6801efde-d18d-42e8-a7b7-cd95af4e133c tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.148242 Oct 06 11:14:44.921050 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 492/992] 10.222.0.52 () {60 vars in 1156 bytes} [Thu Oct 6 11:14:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 11:14:44.926182 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40d4db8b-a098-4665-a16b-81bbd7260192 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Action: 'create', calling method: .version_select at 0x7f92a6decb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1472769379", "metadata": {"Type": "work"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40d4db8b-a098-4665-a16b-81bbd7260192 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Request method failure captured: Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 120 Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrikUH1iQipKiOcHPsNe28W_wMOujg0ucbYmhlHL6dbdXrfAbjcGZbMWKb5g4RaIrIG2FyE5Hq1zN1XuqM8Jd0yfXw8ua6H3APjss2lOKpE-03WPJKY5SKhZKw_7KkXIYY74uXWg8AFJ2JR0XvbaCVzqiXBmnICVuaXil_b5CVttwoA Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:14:44.931039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 075061bd2a174dc5823d04f292c9de7b Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1472769379", "metadata": {"Type": "work"}}} Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: Oct 06 11:14:44.932524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1472769379', 'metadata': {'Type': 'work'}}}} Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi '0' Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:44.933360 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 11:14:44.934707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 11:14:44.936016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 11:14:44.936016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.936016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40d4db8b-a098-4665-a16b-81bbd7260192 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:44.936016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40d4db8b-a098-4665-a16b-81bbd7260192 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010964 Oct 06 11:14:44.936016 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 501/993] 10.222.0.52 () {60 vars in 1156 bytes} [Thu Oct 6 11:14:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 11:14:44.942694 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43159084-9776-4253-9859-63ffec2b6e6d tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Action: 'create', calling method: .version_select at 0x7f92a6c50820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1218449970", "metadata": {"Type": "work"}}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43159084-9776-4253-9859-63ffec2b6e6d tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Request method failure captured: Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 119 Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrikUH1iQipKiOcHPsNe28W_wMOujg0ucbYmhlHL6dbdXrfAbjcGZbMWKb5g4RaIrIG2FyE5Hq1zN1XuqM8Jd0yfXw8ua6H3APjss2lOKpE-03WPJKY5SKhZKw_7KkXIYY74uXWg8AFJ2JR0XvbaCVzqiXBmnICVuaXil_b5CVttwoA Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:14:44.946434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 075061bd2a174dc5823d04f292c9de7b Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1218449970", "metadata": {"Type": "work"}}} Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: Oct 06 11:14:44.948198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1218449970', 'metadata': {'Type': 'work'}}}} Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi '' Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:44.949158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 11:14:44.950818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 11:14:44.952237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 11:14:44.952237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:44.952237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43159084-9776-4253-9859-63ffec2b6e6d tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:44.952237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43159084-9776-4253-9859-63ffec2b6e6d tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009668 Oct 06 11:14:44.954849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 493/994] 10.222.0.52 () {60 vars in 1156 bytes} [Thu Oct 6 11:14:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 06 11:14:44.960128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a509933-dbb9-4348-9774-e2985284c634 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Calling method '.version_select at 0x7f92a6ece9d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:44.992247 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-7a509933-dbb9-4348-9774-e2985284c634 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] HTTP exception thrown: Volume tempest-invalid-1978022330 could not be found. Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a509933-dbb9-4348-9774-e2985284c634 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Request method failure captured: Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1978022330 HTTP/1.1 Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrikUH1iQipKiOcHPsNe28W_wMOujg0ucbYmhlHL6dbdXrfAbjcGZbMWKb5g4RaIrIG2FyE5Hq1zN1XuqM8Jd0yfXw8ua6H3APjss2lOKpE-03WPJKY5SKhZKw_7KkXIYY74uXWg8AFJ2JR0XvbaCVzqiXBmnICVuaXil_b5CVttwoA Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:14:45.005071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 075061bd2a174dc5823d04f292c9de7b Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Volume tempest-invalid-1978022330 could not be found. Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': 'tempest-invalid-1978022330'} Oct 06 11:14:45.006893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1978022330 could not be found. (HTTP 404) (Request-ID: req-c556b808-58aa-479c-ac02-f85c3445f570) Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:45.007982 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 11:14:45.009486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1978022330 could not be found. Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:14:45.011312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1978022330 could not be found. Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1978022330 could not be found. Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a509933-dbb9-4348-9774-e2985284c634 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Returning 404 to user: Volume tempest-invalid-1978022330 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a509933-dbb9-4348-9774-e2985284c634 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1978022330" status: 404 len: 99 microversion: 2.1 time: 0.055567 Oct 06 11:14:45.013575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 502/995] 10.222.0.52 () {58 vars in 1218 bytes} [Thu Oct 6 11:14:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1978022330 => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 06 11:14:45.024277 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c49350df-c3e6-4ebc-b95c-af4ae772e551 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005134 Oct 06 11:14:45.024954 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 494/996] 10.222.0.52 () {58 vars in 1140 bytes} [Thu Oct 6 11:14:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 11:14:45.034429 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65b87c7a-67fd-4c91-8c7e-9a3398d6e0e7 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004065 Oct 06 11:14:45.039323 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 503/997] 10.222.0.52 () {58 vars in 1137 bytes} [Thu Oct 6 11:14:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 11:14:45.044805 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f8a2967-c146-4220-9020-1dcb4ac3e548 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Calling method '.version_select at 0x7f92a6c50820>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:45.080608 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-7f8a2967-c146-4220-9020-1dcb4ac3e548 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] HTTP exception thrown: Volume e0ab500c-c4c8-4d86-ad1c-f06d10cea73c could not be found. Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f8a2967-c146-4220-9020-1dcb4ac3e548 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Request method failure captured: Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-volumes/e0ab500c-c4c8-4d86-ad1c-f06d10cea73c HTTP/1.1 Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrikUH1iQipKiOcHPsNe28W_wMOujg0ucbYmhlHL6dbdXrfAbjcGZbMWKb5g4RaIrIG2FyE5Hq1zN1XuqM8Jd0yfXw8ua6H3APjss2lOKpE-03WPJKY5SKhZKw_7KkXIYY74uXWg8AFJ2JR0XvbaCVzqiXBmnICVuaXil_b5CVttwoA Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:14:45.083865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 075061bd2a174dc5823d04f292c9de7b Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Volume e0ab500c-c4c8-4d86-ad1c-f06d10cea73c could not be found. Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': 'e0ab500c-c4c8-4d86-ad1c-f06d10cea73c'} Oct 06 11:14:45.085532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e0ab500c-c4c8-4d86-ad1c-f06d10cea73c could not be found. (HTTP 404) (Request-ID: req-65e65e58-5d10-43ca-9364-a74ed72680dc) Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:45.086520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 11:14:45.087868 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e0ab500c-c4c8-4d86-ad1c-f06d10cea73c could not be found. Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 11:14:45.089206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e0ab500c-c4c8-4d86-ad1c-f06d10cea73c could not be found. Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e0ab500c-c4c8-4d86-ad1c-f06d10cea73c could not be found. Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f8a2967-c146-4220-9020-1dcb4ac3e548 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Returning 404 to user: Volume e0ab500c-c4c8-4d86-ad1c-f06d10cea73c could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f8a2967-c146-4220-9020-1dcb4ac3e548 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/e0ab500c-c4c8-4d86-ad1c-f06d10cea73c" status: 404 len: 109 microversion: 2.1 time: 0.046856 Oct 06 11:14:45.090614 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 495/998] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Oct 6 11:14:45 2022] DELETE /compute/v2.1/os-volumes/e0ab500c-c4c8-4d86-ad1c-f06d10cea73c => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:14:45.099402 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86ad84e9-689c-4a5b-a1d6-dabe53e92ed8 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Calling method '.version_select at 0x7f92a6decdc0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:14:45.127427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-86ad84e9-689c-4a5b-a1d6-dabe53e92ed8 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] HTTP exception thrown: Volume d31e77b4-1047-463c-a9ed-fbcf17371f21 could not be found. Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86ad84e9-689c-4a5b-a1d6-dabe53e92ed8 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Request method failure captured: Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/os-volumes/d31e77b4-1047-463c-a9ed-fbcf17371f21 HTTP/1.1 Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrikUH1iQipKiOcHPsNe28W_wMOujg0ucbYmhlHL6dbdXrfAbjcGZbMWKb5g4RaIrIG2FyE5Hq1zN1XuqM8Jd0yfXw8ua6H3APjss2lOKpE-03WPJKY5SKhZKw_7KkXIYY74uXWg8AFJ2JR0XvbaCVzqiXBmnICVuaXil_b5CVttwoA Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:14:45.130408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_946d081e3c9143659e7f805a368fd6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 946d081e3c9143659e7f805a368fd6eb Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-899590918 Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 075061bd2a174dc5823d04f292c9de7b Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-899590918-project Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Volume d31e77b4-1047-463c-a9ed-fbcf17371f21 could not be found. Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': 'd31e77b4-1047-463c-a9ed-fbcf17371f21'} Oct 06 11:14:45.131801 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d31e77b4-1047-463c-a9ed-fbcf17371f21 could not be found. (HTTP 404) (Request-ID: req-9c21b3c4-db62-4cf4-967e-981623742c67) Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:45.136502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 11:14:45.137708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d31e77b4-1047-463c-a9ed-fbcf17371f21 could not be found. Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 11:14:45.138893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d31e77b4-1047-463c-a9ed-fbcf17371f21 could not be found. Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d31e77b4-1047-463c-a9ed-fbcf17371f21 could not be found. Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86ad84e9-689c-4a5b-a1d6-dabe53e92ed8 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] Returning 404 to user: Volume d31e77b4-1047-463c-a9ed-fbcf17371f21 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-86ad84e9-689c-4a5b-a1d6-dabe53e92ed8 tempest-VolumesNegativeTest-899590918 tempest-VolumesNegativeTest-899590918-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d31e77b4-1047-463c-a9ed-fbcf17371f21" status: 404 len: 109 microversion: 2.1 time: 0.036647 Oct 06 11:14:45.140644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 504/999] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:14:45 2022] GET /compute/v2.1/os-volumes/d31e77b4-1047-463c-a9ed-fbcf17371f21 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:15:12.745834 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:12.746700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:12.751080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-433764d2-00f2-4897-be96-2ecbe092a272 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:12.753239 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-433764d2-00f2-4897-be96-2ecbe092a272 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:12.761688 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-433764d2-00f2-4897-be96-2ecbe092a272 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:12.762159 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-433764d2-00f2-4897-be96-2ecbe092a272 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:12.762598 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-433764d2-00f2-4897-be96-2ecbe092a272 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:12.763302 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-433764d2-00f2-4897-be96-2ecbe092a272 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:12.763759 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-433764d2-00f2-4897-be96-2ecbe092a272 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:12.764228 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-433764d2-00f2-4897-be96-2ecbe092a272 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:12.794039 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-433764d2-00f2-4897-be96-2ecbe092a272 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049525 Oct 06 11:15:12.794595 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 496/1000] 10.222.0.52 () {60 vars in 1343 bytes} [Thu Oct 6 11:15:12 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:12.855745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:12.856627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=53 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:12.861355 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-955c2492-3ac9-4afc-a97b-b86a4fb2a86c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:12.861952 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-955c2492-3ac9-4afc-a97b-b86a4fb2a86c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:12.870407 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-955c2492-3ac9-4afc-a97b-b86a4fb2a86c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:12.870897 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-955c2492-3ac9-4afc-a97b-b86a4fb2a86c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:12.871343 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-955c2492-3ac9-4afc-a97b-b86a4fb2a86c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:12.872081 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-955c2492-3ac9-4afc-a97b-b86a4fb2a86c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:12.872549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-955c2492-3ac9-4afc-a97b-b86a4fb2a86c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:12.872981 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-955c2492-3ac9-4afc-a97b-b86a4fb2a86c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:12.898940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-955c2492-3ac9-4afc-a97b-b86a4fb2a86c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:15:12.972309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-955c2492-3ac9-4afc-a97b-b86a4fb2a86c tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "DELETE /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 204 len: 0 microversion: 2.20 time: 0.117717 Oct 06 11:15:12.973019 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 505/1001] 10.222.0.52 () {60 vars in 1280 bytes} [Thu Oct 6 11:15:12 2022] DELETE /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 11:15:12.981606 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:12.982217 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:12.988559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:12.989047 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:12.989486 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:12.990179 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:12.991328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:12.991991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:13.119755 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:13.128479 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:13.130043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:13.131896 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-29912d34-c117-435e-ba36-5ba84ffaa5c0 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.153521 Oct 06 11:15:13.132577 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 497/1002] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:15:12 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:15:14.158235 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:14.158937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:14.165463 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:14.165980 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:14.166413 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:14.167103 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:14.167557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:14.168009 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:14.300540 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:14.308740 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:14.310207 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:14.311372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-858ef746-3ab0-479a-a4aa-07a995273287 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.157625 Oct 06 11:15:14.311956 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 506/1003] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:15:14 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:15:15.337617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:15.338230 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:15.344681 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:15.345224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:15.345659 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:15.346351 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:15.346797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:15.347216 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:15.476856 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:15.484847 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:15.486338 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:15.487493 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b41e6bc-8dea-4c92-b870-625180f5c7a2 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.154499 Oct 06 11:15:15.488078 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 498/1004] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:15:15 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:15:16.513008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:16.513619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:16.519650 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:16.520159 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:16.520595 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:16.521282 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:16.522739 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:16.523294 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:16.651476 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:16.659394 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:16.660858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:16.662009 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-460cb4f4-55dd-4788-a606-ff13010583f5 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.152918 Oct 06 11:15:16.662858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 507/1005] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:15:16 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:15:17.687376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:17.687957 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:17.694393 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:17.694873 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:17.695307 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:17.696044 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:17.696508 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:17.696928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:17.831339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:17.840117 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:17.841556 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:17.842712 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-137fcd2d-a4a7-4b61-ace2-631718d78383 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1724 microversion: 2.20 time: 0.159324 Oct 06 11:15:17.843397 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 499/1006] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:15:17 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:15:18.868788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:18.869499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:18.876768 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:18.877307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:18.877729 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:18.878435 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:18.879299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:18.879732 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:18.962391 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:18.971005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:18.972647 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56835f0c8dc0416d9fa70662e40c856d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b886dc365684ab1811d100eb5774619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:18.973995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f8dae38-4b1d-4421-90c3-c95c5c9a8b9f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 200 len: 1656 microversion: 2.20 time: 0.110245 Oct 06 11:15:18.974568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 508/1007] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:15:18 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 1656 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 11:15:19.336797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-5562861a-90da-4b9e-bca2-df519fe24295 req-9abb9bcc-fa88-4d46-bf6a-ec64cd0a5f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16531807-aeec-439c-8671-699762bf520f", "name": "network-vif-deleted", "tag": "d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:19.361983 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5562861a-90da-4b9e-bca2-df519fe24295 req-9abb9bcc-fa88-4d46-bf6a-ec64cd0a5f31 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:19.362669 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5562861a-90da-4b9e-bca2-df519fe24295 req-9abb9bcc-fa88-4d46-bf6a-ec64cd0a5f31 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:19.367147 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5562861a-90da-4b9e-bca2-df519fe24295 req-9abb9bcc-fa88-4d46-bf6a-ec64cd0a5f31 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:19.379052 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5562861a-90da-4b9e-bca2-df519fe24295 req-9abb9bcc-fa88-4d46-bf6a-ec64cd0a5f31 service nova] Creating event network-vif-deleted:d4919a14-5bb2-4e62-ac3c-71ab5f0e6c0d for instance 16531807-aeec-439c-8671-699762bf520f on hv-cinder-86020 Oct 06 11:15:19.389746 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-5562861a-90da-4b9e-bca2-df519fe24295 req-9abb9bcc-fa88-4d46-bf6a-ec64cd0a5f31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239878 Oct 06 11:15:19.393075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 500/1008] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:15:19.999617 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:20.000192 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:20.007476 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:20.007999 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:20.008441 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:20.009157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:20.009611 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:20.010157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:20.025220 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] HTTP exception thrown: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Request method failure captured: Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f HTTP/1.1 Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrYttKBuvPgE7DG1oPbMv6f_tPHD4OtAPVW9Mnrl05Y1xZW27nNfKO7Ph_ZupSJjoqD5_MacX356Zb7RsTXzqjoKmpYMFbWTbW9IG0mFs0HHE7VcCMIblIw-kN6dSqaJSSRJYaH1wSK4516vovqqPGmdbnSFrbBJaW2ACi6KpCuTpqo Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:15:20.027719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b886dc365684ab1811d100eb5774619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b886dc365684ab1811d100eb5774619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 56835f0c8dc0416d9fa70662e40c856d Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:20.029352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '16531807-aeec-439c-8671-699762bf520f'} Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:15:20.030200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:20.032551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:20.034068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Returning 404 to user: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:15:20.034068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14b3dcbd-8d13-4652-9769-d1bf2aefb54f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 404 len: 111 microversion: 2.20 time: 0.034651 Oct 06 11:15:20.034068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 509/1009] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:15:19 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 06 11:15:20.042427 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dbce9921-0a0d-4014-8395-bbaf3d3c1aa3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '.version_select at 0x7f92a6e2ea60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:20.064867 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dbce9921-0a0d-4014-8395-bbaf3d3c1aa3 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978804717" status: 204 len: 0 microversion: 2.20 time: 0.028332 Oct 06 11:15:20.065776 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 501/1010] 10.222.0.52 () {60 vars in 1262 bytes} [Thu Oct 6 11:15:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978804717 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 11:15:22.028633 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:22.029266 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:22.035913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:22.036411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:22.036855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:22.037621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:22.038091 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:22.038726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:22.052335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] HTTP exception thrown: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Request method failure captured: Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f HTTP/1.1 Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrYttKBuvPgE7DG1oPbMv6f_tPHD4OtAPVW9Mnrl05Y1xZW27nNfKO7Ph_ZupSJjoqD5_MacX356Zb7RsTXzqjoKmpYMFbWTbW9IG0mFs0HHE7VcCMIblIw-kN6dSqaJSSRJYaH1wSK4516vovqqPGmdbnSFrbBJaW2ACi6KpCuTpqo Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:15:22.054558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b886dc365684ab1811d100eb5774619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b886dc365684ab1811d100eb5774619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 56835f0c8dc0416d9fa70662e40c856d Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:22.056378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '16531807-aeec-439c-8671-699762bf520f'} Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:15:22.057188 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:22.058619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:22.060477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Returning 404 to user: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:15:22.060477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c3939e3-35c7-4c97-af8c-ded049419732 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "DELETE /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 404 len: 111 microversion: 2.20 time: 0.031775 Oct 06 11:15:22.060477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 510/1011] 10.222.0.52 () {60 vars in 1280 bytes} [Thu Oct 6 11:15:22 2022] DELETE /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 11:15:22.065960 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:22.066829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: 16531807-aeec-439c-8671-699762bf520f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:22.075928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:22.076428 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:22.076869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:22.077580 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:22.078037 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:22.078468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:22.091916 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] HTTP exception thrown: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Request method failure captured: Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f HTTP/1.1 Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYttKBuvPgE7DG1oPbMv6f_tPHD4OtAPVW9Mnrl05Y1xZW27nNfKO7Ph_ZupSJjoqD5_MacX356Zb7RsTXzqjoKmpYMFbWTbW9IG0mFs0HHE7VcCMIblIw-kN6dSqaJSSRJYaH1wSK4516vovqqPGmdbnSFrbBJaW2ACi6KpCuTpqo Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:15:22.093589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b886dc365684ab1811d100eb5774619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b886dc365684ab1811d100eb5774619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 56835f0c8dc0416d9fa70662e40c856d Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:22.095218 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '16531807-aeec-439c-8671-699762bf520f'} Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:15:22.096154 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. Oct 06 11:15:22.097638 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:22.098924 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Returning 404 to user: Instance 16531807-aeec-439c-8671-699762bf520f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:15:22.098924 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-956b685c-c0a6-4d7d-a7f5-5dc100903c63 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f" status: 404 len: 111 microversion: 2.20 time: 0.033447 Oct 06 11:15:22.098924 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 502/1012] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:15:22 2022] GET /compute/v2.1/servers/16531807-aeec-439c-8671-699762bf520f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 06 11:15:23.245821 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:23.246320 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:23.253116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:23.253614 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:23.254089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:23.254800 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:23.255294 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:23.256303 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:23.270145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] HTTP exception thrown: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Request method failure captured: Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b HTTP/1.1 Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrYttKBuvPgE7DG1oPbMv6f_tPHD4OtAPVW9Mnrl05Y1xZW27nNfKO7Ph_ZupSJjoqD5_MacX356Zb7RsTXzqjoKmpYMFbWTbW9IG0mFs0HHE7VcCMIblIw-kN6dSqaJSSRJYaH1wSK4516vovqqPGmdbnSFrbBJaW2ACi6KpCuTpqo Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:15:23.272788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b886dc365684ab1811d100eb5774619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b886dc365684ab1811d100eb5774619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 56835f0c8dc0416d9fa70662e40c856d Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:15:23.274410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': 'ea9fceeb-0987-4e4f-b34b-f524fa791d3b'} Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:15:23.275337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:15:23.276806 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:23.278269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Returning 404 to user: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:15:23.278269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13d71640-c3a9-4264-aa5c-02d1449db99f tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 404 len: 111 microversion: 2.20 time: 0.032476 Oct 06 11:15:23.278269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 511/1013] 10.222.0.52 () {60 vars in 1280 bytes} [Thu Oct 6 11:15:23 2022] DELETE /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 11:15:23.283948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:23.284650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] [instance: ea9fceeb-0987-4e4f-b34b-f524fa791d3b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:23.292072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:23.292495 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:23.292939 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:23.293644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:23.294254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:23.294609 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:23.308023 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] HTTP exception thrown: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Request method failure captured: Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b HTTP/1.1 Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrYttKBuvPgE7DG1oPbMv6f_tPHD4OtAPVW9Mnrl05Y1xZW27nNfKO7Ph_ZupSJjoqD5_MacX356Zb7RsTXzqjoKmpYMFbWTbW9IG0mFs0HHE7VcCMIblIw-kN6dSqaJSSRJYaH1wSK4516vovqqPGmdbnSFrbBJaW2ACi6KpCuTpqo Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:15:23.309575 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b886dc365684ab1811d100eb5774619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b886dc365684ab1811d100eb5774619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b886dc365684ab1811d100eb5774619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 5b886dc365684ab1811d100eb5774619 Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250260164 Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 56835f0c8dc0416d9fa70662e40c856d Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250260164-project Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:15:23.311315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': 'ea9fceeb-0987-4e4f-b34b-f524fa791d3b'} Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:15:23.312248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. Oct 06 11:15:23.313695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:23.315123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] Returning 404 to user: Instance ea9fceeb-0987-4e4f-b34b-f524fa791d3b could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:15:23.315123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-843b6fe1-61d3-4102-9639-87be6414cc81 tempest-AttachVolumeShelveTestJSON-1250260164 tempest-AttachVolumeShelveTestJSON-1250260164-project] 10.222.0.52 "GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b" status: 404 len: 111 microversion: 2.20 time: 0.030962 Oct 06 11:15:23.315123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 503/1014] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Oct 6 11:15:23 2022] GET /compute/v2.1/servers/ea9fceeb-0987-4e4f-b34b-f524fa791d3b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 06 11:15:28.224837 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cea535cd-aefd-4cc6-95b9-8b8ff69b0c3c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-335297420"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:28.225526 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cea535cd-aefd-4cc6-95b9-8b8ff69b0c3c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:28.232367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea535cd-aefd-4cc6-95b9-8b8ff69b0c3c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:28.233000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea535cd-aefd-4cc6-95b9-8b8ff69b0c3c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:28.233483 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea535cd-aefd-4cc6-95b9-8b8ff69b0c3c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:28.234185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea535cd-aefd-4cc6-95b9-8b8ff69b0c3c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:28.234648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea535cd-aefd-4cc6-95b9-8b8ff69b0c3c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:28.235082 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea535cd-aefd-4cc6-95b9-8b8ff69b0c3c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:28.376783 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.network.security_group_api [None req-cea535cd-aefd-4cc6-95b9-8b8ff69b0c3c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Removing security group 11ee5993-abd0-464f-9325-9dab2779718f from port 94650b61-76aa-4105-9fd3-7f1db6829887 Oct 06 11:15:29.322260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cea535cd-aefd-4cc6-95b9-8b8ff69b0c3c tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "POST /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/action" status: 202 len: 0 microversion: 2.1 time: 1.101345 Oct 06 11:15:29.322951 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 512/1015] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:15:28 2022] POST /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/action => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:15:29.350250 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b3381f0d-888c-44dd-a371-5557525d80d3 req-864a893b-707c-45d2-8794-a69cebd7173a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc20029-503a-4c89-b422-088e3676b9c4", "tag": "94650b61-76aa-4105-9fd3-7f1db6829887"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:29.380841 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b3381f0d-888c-44dd-a371-5557525d80d3 req-864a893b-707c-45d2-8794-a69cebd7173a service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:29.382758 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b3381f0d-888c-44dd-a371-5557525d80d3 req-864a893b-707c-45d2-8794-a69cebd7173a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:29.386344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b3381f0d-888c-44dd-a371-5557525d80d3 req-864a893b-707c-45d2-8794-a69cebd7173a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:29.413740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b3381f0d-888c-44dd-a371-5557525d80d3 req-864a893b-707c-45d2-8794-a69cebd7173a service nova] Creating event network-changed:94650b61-76aa-4105-9fd3-7f1db6829887 for instance 5fc20029-503a-4c89-b422-088e3676b9c4 on hv-cinder-86020 Oct 06 11:15:29.421590 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b3381f0d-888c-44dd-a371-5557525d80d3 req-864a893b-707c-45d2-8794-a69cebd7173a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075478 Oct 06 11:15:29.423729 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 504/1016] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:15:31.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d814cf89-6260-448a-8d7e-21c4b92f10e6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:31.026872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d814cf89-6260-448a-8d7e-21c4b92f10e6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:31.032618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-30e1efd7-4ec6-4b3e-adf7-7af76bdc0df3 req-19935e12-e351-4f9e-a331-df473e7742b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc20029-503a-4c89-b422-088e3676b9c4", "tag": "94650b61-76aa-4105-9fd3-7f1db6829887"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:31.051460 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-30e1efd7-4ec6-4b3e-adf7-7af76bdc0df3 req-19935e12-e351-4f9e-a331-df473e7742b0 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:31.051823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d814cf89-6260-448a-8d7e-21c4b92f10e6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:31.052374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d814cf89-6260-448a-8d7e-21c4b92f10e6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:31.052706 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-30e1efd7-4ec6-4b3e-adf7-7af76bdc0df3 req-19935e12-e351-4f9e-a331-df473e7742b0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:31.052959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d814cf89-6260-448a-8d7e-21c4b92f10e6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:31.053695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-30e1efd7-4ec6-4b3e-adf7-7af76bdc0df3 req-19935e12-e351-4f9e-a331-df473e7742b0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:31.055582 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d814cf89-6260-448a-8d7e-21c4b92f10e6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:31.065865 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d814cf89-6260-448a-8d7e-21c4b92f10e6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:31.067573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-30e1efd7-4ec6-4b3e-adf7-7af76bdc0df3 req-19935e12-e351-4f9e-a331-df473e7742b0 service nova] Creating event network-changed:94650b61-76aa-4105-9fd3-7f1db6829887 for instance 5fc20029-503a-4c89-b422-088e3676b9c4 on hv-cinder-86020 Oct 06 11:15:31.067710 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d814cf89-6260-448a-8d7e-21c4b92f10e6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:31.073245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-30e1efd7-4ec6-4b3e-adf7-7af76bdc0df3 req-19935e12-e351-4f9e-a331-df473e7742b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055155 Oct 06 11:15:31.076300 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 505/1017] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:15:31.210745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-d814cf89-6260-448a-8d7e-21c4b92f10e6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lazy-loading 'services' on Instance uuid 5fc20029-503a-4c89-b422-088e3676b9c4 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:15:31.363754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d814cf89-6260-448a-8d7e-21c4b92f10e6 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments/a67990e6-2c1d-4af2-aab6-f2f8c22a0983" status: 202 len: 0 microversion: 2.1 time: 0.347375 Oct 06 11:15:31.365747 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 513/1018] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:15:31 2022] DELETE /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments/a67990e6-2c1d-4af2-aab6-f2f8c22a0983 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:15:31.375523 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b032052f-67a2-431c-b942-2e627b43c846 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:31.378611 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b032052f-67a2-431c-b942-2e627b43c846 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:31.394706 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b032052f-67a2-431c-b942-2e627b43c846 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:31.395560 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b032052f-67a2-431c-b942-2e627b43c846 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:31.401357 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b032052f-67a2-431c-b942-2e627b43c846 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:31.403471 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b032052f-67a2-431c-b942-2e627b43c846 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:31.404224 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b032052f-67a2-431c-b942-2e627b43c846 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:31.404872 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b032052f-67a2-431c-b942-2e627b43c846 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:31.449406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b032052f-67a2-431c-b942-2e627b43c846 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072762 Oct 06 11:15:31.450528 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 506/1019] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:15:31 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:15:32.464111 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d4eadd3f-8c13-4bc6-86b2-7c6fdbed3bc0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:32.468062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d4eadd3f-8c13-4bc6-86b2-7c6fdbed3bc0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:32.482340 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eadd3f-8c13-4bc6-86b2-7c6fdbed3bc0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:32.485498 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eadd3f-8c13-4bc6-86b2-7c6fdbed3bc0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:32.487276 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eadd3f-8c13-4bc6-86b2-7c6fdbed3bc0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:32.488089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eadd3f-8c13-4bc6-86b2-7c6fdbed3bc0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:32.488860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eadd3f-8c13-4bc6-86b2-7c6fdbed3bc0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:32.489290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eadd3f-8c13-4bc6-86b2-7c6fdbed3bc0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:32.588663 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d4eadd3f-8c13-4bc6-86b2-7c6fdbed3bc0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129406 Oct 06 11:15:32.592269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 514/1020] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:15:32 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:15:33.604077 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2f1f374a-6e3c-457b-bd5b-4d95b0368ffd tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:33.606462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2f1f374a-6e3c-457b-bd5b-4d95b0368ffd tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:33.621721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f1f374a-6e3c-457b-bd5b-4d95b0368ffd tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:33.622543 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f1f374a-6e3c-457b-bd5b-4d95b0368ffd tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:33.623889 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f1f374a-6e3c-457b-bd5b-4d95b0368ffd tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:33.624796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f1f374a-6e3c-457b-bd5b-4d95b0368ffd tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:33.625423 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f1f374a-6e3c-457b-bd5b-4d95b0368ffd tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:33.625855 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f1f374a-6e3c-457b-bd5b-4d95b0368ffd tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:33.658525 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2f1f374a-6e3c-457b-bd5b-4d95b0368ffd tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059625 Oct 06 11:15:33.659301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 507/1021] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:15:33 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 11:15:33.671506 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:33.672067 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:33.680114 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:33.680851 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:33.681490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:33.682301 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:33.682944 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:33.683720 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:33.798400 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] HTTP exception thrown: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 is not attached to volume a67990e6-2c1d-4af2-aab6-f2f8c22a0983 Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Request method failure captured: Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments/a67990e6-2c1d-4af2-aab6-f2f8c22a0983 HTTP/1.1 Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrfLWc-kFp4n4Z8YIVLo24sHq1k65DYRQqWRuxstub9i503TjmkOQr8EvJBXE4fxpyKUVHIiWQSXRlTVSF5N5HbyeaDIIW-mjiIDHI7SeEHQOxfq0L9eK_-AS6VedwgI7Tg1UwQAWIDblvDZRCUHcHKUFxnpUcX4AdlCSnJ_W6Sa66I Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: ca311e63675241eaaef42a8154e905ac Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-TestMinimumBasicScenario-1250387854 Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:15:33.808117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ca311e63675241eaaef42a8154e905ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ca311e63675241eaaef42a8154e905ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ca311e63675241eaaef42a8154e905ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ca311e63675241eaaef42a8154e905ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-TestMinimumBasicScenario-1250387854 Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: ca311e63675241eaaef42a8154e905ac Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1250387854 Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-TestMinimumBasicScenario-1250387854-project Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 5a5f8ee0a7fd4d7a9d34e211dabab48a Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-TestMinimumBasicScenario-1250387854-project Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:15:33.809953 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 is not attached to volume a67990e6-2c1d-4af2-aab6-f2f8c22a0983 Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'server_id': '5fc20029-503a-4c89-b422-088e3676b9c4', 'id': 'a67990e6-2c1d-4af2-aab6-f2f8c22a0983'} Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a67990e6-2c1d-4af2-aab6-f2f8c22a0983. Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:15:33.810855 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 is not attached to volume a67990e6-2c1d-4af2-aab6-f2f8c22a0983 Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 is not attached to volume a67990e6-2c1d-4af2-aab6-f2f8c22a0983 Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:15:33.812384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Returning 404 to user: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 is not attached to volume a67990e6-2c1d-4af2-aab6-f2f8c22a0983 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:15:33.813398 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-20af2951-8e8b-4965-82d4-c14eaa1fbd5b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments/a67990e6-2c1d-4af2-aab6-f2f8c22a0983" status: 404 len: 154 microversion: 2.1 time: 0.143133 Oct 06 11:15:33.814069 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 515/1022] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:15:33 2022] DELETE /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4/os-volume_attachments/a67990e6-2c1d-4af2-aab6-f2f8c22a0983 => generated 154 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:15:34.372442 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-269d4f31-80e7-4f65-84e2-471c466c648f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: .version_select at 0x7f92a6f21c10>, body: {"keypair": {"name": "tempest-keypair-221963501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4aAXLd438kwG5f9KjVyQkrXftOgwFTWCFtAqSUby1xj7SIxDBhwXmljGOlkNMkrn+ebkVebcoZFBuSP2BrgRfZ0vk7b4hKEFPCkqBHgx950stMEUWlTq9DRZYgJmpgIg=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:34.393101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-269d4f31-80e7-4f65-84e2-471c466c648f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:15:34.397396 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-269d4f31-80e7-4f65-84e2-471c466c648f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for user 4ad5a3ee5ab545e2893d4f6365f8f939 and project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:15:34.422882 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-269d4f31-80e7-4f65-84e2-471c466c648f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.337560 Oct 06 11:15:34.423216 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 508/1023] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Oct 6 11:15:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:15:35.048843 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b583768b-258d-4d82-90d4-92322771d1f8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:35.049469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b583768b-258d-4d82-90d4-92322771d1f8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:35.057721 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b583768b-258d-4d82-90d4-92322771d1f8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:35.059087 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b583768b-258d-4d82-90d4-92322771d1f8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:35.059780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b583768b-258d-4d82-90d4-92322771d1f8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:35.061172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b583768b-258d-4d82-90d4-92322771d1f8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:35.061972 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b583768b-258d-4d82-90d4-92322771d1f8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:35.062773 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b583768b-258d-4d82-90d4-92322771d1f8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:35.099057 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b583768b-258d-4d82-90d4-92322771d1f8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:15:35.210589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b583768b-258d-4d82-90d4-92322771d1f8 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 204 len: 0 microversion: 2.1 time: 0.165009 Oct 06 11:15:35.211522 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 516/1024] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:15:35 2022] DELETE /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:15:35.221516 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-900efe9f-db41-4566-8c10-da210cfa9a7b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:35.222209 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-900efe9f-db41-4566-8c10-da210cfa9a7b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:35.230611 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-900efe9f-db41-4566-8c10-da210cfa9a7b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:35.231105 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-900efe9f-db41-4566-8c10-da210cfa9a7b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:35.231540 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-900efe9f-db41-4566-8c10-da210cfa9a7b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:35.232284 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-900efe9f-db41-4566-8c10-da210cfa9a7b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:35.232913 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-900efe9f-db41-4566-8c10-da210cfa9a7b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:35.233380 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-900efe9f-db41-4566-8c10-da210cfa9a7b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:35.399182 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-900efe9f-db41-4566-8c10-da210cfa9a7b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:35.407259 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-900efe9f-db41-4566-8c10-da210cfa9a7b tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1552 microversion: 2.1 time: 0.191036 Oct 06 11:15:35.407831 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 509/1025] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:35 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1552 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:35.969715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1050623218", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d576013-5c41-470a-82ec-fbb07f6bd986"}], "security_groups": [{"name": "tempest-securitygroup--1624257792"}], "key_name": "tempest-keypair-221963501", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:36.096312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] validate_networks() for [('8d576013-5c41-470a-82ec-fbb07f6bd986', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:15:36.433503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9b4fd4b-096f-417e-9c6d-d18461147ed9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:36.434132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e9b4fd4b-096f-417e-9c6d-d18461147ed9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:36.441030 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd4b-096f-417e-9c6d-d18461147ed9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:36.441794 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd4b-096f-417e-9c6d-d18461147ed9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:36.442295 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd4b-096f-417e-9c6d-d18461147ed9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:36.443234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd4b-096f-417e-9c6d-d18461147ed9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:36.443698 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd4b-096f-417e-9c6d-d18461147ed9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:36.445079 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd4b-096f-417e-9c6d-d18461147ed9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:36.621280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e9b4fd4b-096f-417e-9c6d-d18461147ed9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:36.635341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e9b4fd4b-096f-417e-9c6d-d18461147ed9 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1552 microversion: 2.1 time: 0.205681 Oct 06 11:15:36.639460 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 510/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:36 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1552 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:36.899946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:15:36.900381 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:15:36.902276 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:15:36.903650 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:15:36.904136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:15:36.918654 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:36.919274 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:36.919798 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:36.920845 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:36.921372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:36.922039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:36.942661 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:15:36.948084 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for user 4ad5a3ee5ab545e2893d4f6365f8f939 and project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:15:36.960350 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:15:36.963502 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:15:37.016657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9234e0c-2bf7-46d7-a863-0149fe810b50 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.051649 Oct 06 11:15:37.017785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 517/1027] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:15:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:15:37.034006 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9bbd7ff7-e2c4-4dfc-8159-6a2ef184e155 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:37.034624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9bbd7ff7-e2c4-4dfc-8159-6a2ef184e155 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:37.100928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9bbd7ff7-e2c4-4dfc-8159-6a2ef184e155 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:37.118585 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9bbd7ff7-e2c4-4dfc-8159-6a2ef184e155 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1241 microversion: 2.1 time: 0.088313 Oct 06 11:15:37.124612 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 511/1028] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:37 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:37.659030 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3576f47-2cf1-4795-8271-a3ec4e1e07d3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:37.659863 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3576f47-2cf1-4795-8271-a3ec4e1e07d3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:37.667175 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3576f47-2cf1-4795-8271-a3ec4e1e07d3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:37.668585 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3576f47-2cf1-4795-8271-a3ec4e1e07d3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:37.669281 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3576f47-2cf1-4795-8271-a3ec4e1e07d3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:37.670295 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3576f47-2cf1-4795-8271-a3ec4e1e07d3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:37.671091 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3576f47-2cf1-4795-8271-a3ec4e1e07d3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:37.671732 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3576f47-2cf1-4795-8271-a3ec4e1e07d3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:37.869192 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3576f47-2cf1-4795-8271-a3ec4e1e07d3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:37.892239 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3576f47-2cf1-4795-8271-a3ec4e1e07d3 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1552 microversion: 2.1 time: 0.224251 Oct 06 11:15:37.893001 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 518/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:37 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1552 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:38.037684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6d048f05-aa19-4cdc-bae5-c6d7e6c66dce req-491480d2-04d3-4584-ae97-5306775a8f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc20029-503a-4c89-b422-088e3676b9c4", "name": "network-vif-deleted", "tag": "94650b61-76aa-4105-9fd3-7f1db6829887"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:38.053434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d048f05-aa19-4cdc-bae5-c6d7e6c66dce req-491480d2-04d3-4584-ae97-5306775a8f85 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:38.054271 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d048f05-aa19-4cdc-bae5-c6d7e6c66dce req-491480d2-04d3-4584-ae97-5306775a8f85 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:38.054887 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d048f05-aa19-4cdc-bae5-c6d7e6c66dce req-491480d2-04d3-4584-ae97-5306775a8f85 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:38.067225 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6d048f05-aa19-4cdc-bae5-c6d7e6c66dce req-491480d2-04d3-4584-ae97-5306775a8f85 service nova] Creating event network-vif-deleted:94650b61-76aa-4105-9fd3-7f1db6829887 for instance 5fc20029-503a-4c89-b422-088e3676b9c4 on hv-cinder-86020 Oct 06 11:15:38.072872 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6d048f05-aa19-4cdc-bae5-c6d7e6c66dce req-491480d2-04d3-4584-ae97-5306775a8f85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042621 Oct 06 11:15:38.073781 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 512/1030] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:15:38.145864 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-880ceda5-2a74-4b1c-b642-d043703bcb13 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:38.146479 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-880ceda5-2a74-4b1c-b642-d043703bcb13 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:38.153380 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880ceda5-2a74-4b1c-b642-d043703bcb13 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:38.153866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880ceda5-2a74-4b1c-b642-d043703bcb13 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:38.154306 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880ceda5-2a74-4b1c-b642-d043703bcb13 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:38.155015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880ceda5-2a74-4b1c-b642-d043703bcb13 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:38.155473 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880ceda5-2a74-4b1c-b642-d043703bcb13 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:38.155926 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880ceda5-2a74-4b1c-b642-d043703bcb13 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:38.221709 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-880ceda5-2a74-4b1c-b642-d043703bcb13 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:38.229407 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-880ceda5-2a74-4b1c-b642-d043703bcb13 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1293 microversion: 2.1 time: 0.087424 Oct 06 11:15:38.230177 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 519/1031] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:38 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:38.918673 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:38.919521 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:38.927870 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:38.928586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:38.929303 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:38.931025 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:38.931781 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:38.932724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:38.973222 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:38.973222 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:38.973222 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:38.973222 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lazy-loading 'fault' on Instance uuid 5fc20029-503a-4c89-b422-088e3676b9c4 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:15:39.017744 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a5f8ee0a7fd4d7a9d34e211dabab48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e63675241eaaef42a8154e905ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:39.026743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-56bf0aa4-0244-4ad9-844e-71c060dbc834 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 200 len: 1346 microversion: 2.1 time: 0.113118 Oct 06 11:15:39.027326 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 513/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:38 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 1346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:39.252501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db28207e-dad8-437a-891c-a6095f555b37 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:39.253035 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db28207e-dad8-437a-891c-a6095f555b37 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:39.261949 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db28207e-dad8-437a-891c-a6095f555b37 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:39.262615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db28207e-dad8-437a-891c-a6095f555b37 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:39.263305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db28207e-dad8-437a-891c-a6095f555b37 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:39.264742 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db28207e-dad8-437a-891c-a6095f555b37 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:39.265545 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db28207e-dad8-437a-891c-a6095f555b37 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:39.266383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db28207e-dad8-437a-891c-a6095f555b37 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:39.286857 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:39.346253 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-db28207e-dad8-437a-891c-a6095f555b37 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:39.354416 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db28207e-dad8-437a-891c-a6095f555b37 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1299 microversion: 2.1 time: 0.105867 Oct 06 11:15:39.355086 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 520/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:39 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:40.055692 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:40.057182 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] [instance: 5fc20029-503a-4c89-b422-088e3676b9c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:40.065102 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:40.066426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:40.067329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:40.068231 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:40.068835 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:40.070276 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:40.088734 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] HTTP exception thrown: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 could not be found. Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Request method failure captured: Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 HTTP/1.1 Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrfLWc-kFp4n4Z8YIVLo24sHq1k65DYRQqWRuxstub9i503TjmkOQr8EvJBXE4fxpyKUVHIiWQSXRlTVSF5N5HbyeaDIIW-mjiIDHI7SeEHQOxfq0L9eK_-AS6VedwgI7Tg1UwQAWIDblvDZRCUHcHKUFxnpUcX4AdlCSnJ_W6Sa66I Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: ca311e63675241eaaef42a8154e905ac Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-TestMinimumBasicScenario-1250387854 Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:15:40.090624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ca311e63675241eaaef42a8154e905ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ca311e63675241eaaef42a8154e905ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ca311e63675241eaaef42a8154e905ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ca311e63675241eaaef42a8154e905ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-TestMinimumBasicScenario-1250387854 Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: ca311e63675241eaaef42a8154e905ac Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1250387854 Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-TestMinimumBasicScenario-1250387854-project Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 5a5f8ee0a7fd4d7a9d34e211dabab48a Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-TestMinimumBasicScenario-1250387854-project Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 could not be found. Oct 06 11:15:40.092344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '5fc20029-503a-4c89-b422-088e3676b9c4'} Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 could not be found. Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:15:40.093274 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 could not be found. Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 could not be found. Oct 06 11:15:40.094570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:15:40.097310 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Returning 404 to user: Instance 5fc20029-503a-4c89-b422-088e3676b9c4 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:15:40.099468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-77115fbc-c54c-48d1-963c-f57aff6e6eb0 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4" status: 404 len: 111 microversion: 2.1 time: 0.053423 Oct 06 11:15:40.100768 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 514/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:40 2022] GET /compute/v2.1/servers/5fc20029-503a-4c89-b422-088e3676b9c4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:15:40.113208 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5177c01f-ff55-42af-87f7-e1b455179765 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] Calling method '.version_select at 0x7f92a6e43700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:40.143305 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5177c01f-ff55-42af-87f7-e1b455179765 tempest-TestMinimumBasicScenario-1250387854 tempest-TestMinimumBasicScenario-1250387854-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-356737777" status: 202 len: 0 microversion: 2.1 time: 0.035092 Oct 06 11:15:40.143967 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 521/1035] 10.222.0.52 () {58 vars in 1269 bytes} [Thu Oct 6 11:15:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-356737777 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:15:40.378843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d048f1c3-8fe6-4ebc-a6c7-326775247db5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:40.381041 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d048f1c3-8fe6-4ebc-a6c7-326775247db5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:40.400849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d048f1c3-8fe6-4ebc-a6c7-326775247db5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:40.401597 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-20adec6f-2c7d-4fb1-9cbc-9dce066fea62 req-90d2e062-13ac-470e-a78c-b5a438c89753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e437667e-27e0-4c28-8bbd-206763b7d3bb", "tag": "d4154cb8-50f5-4bb6-a532-639edec2c403"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:40.402061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d048f1c3-8fe6-4ebc-a6c7-326775247db5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:40.406451 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d048f1c3-8fe6-4ebc-a6c7-326775247db5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:40.407816 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d048f1c3-8fe6-4ebc-a6c7-326775247db5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:40.408628 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d048f1c3-8fe6-4ebc-a6c7-326775247db5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:40.409798 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d048f1c3-8fe6-4ebc-a6c7-326775247db5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:40.413901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-20adec6f-2c7d-4fb1-9cbc-9dce066fea62 req-90d2e062-13ac-470e-a78c-b5a438c89753 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:40.414383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-20adec6f-2c7d-4fb1-9cbc-9dce066fea62 req-90d2e062-13ac-470e-a78c-b5a438c89753 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:40.415012 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-20adec6f-2c7d-4fb1-9cbc-9dce066fea62 req-90d2e062-13ac-470e-a78c-b5a438c89753 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:40.434602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-20adec6f-2c7d-4fb1-9cbc-9dce066fea62 req-90d2e062-13ac-470e-a78c-b5a438c89753 service nova] Creating event network-changed:d4154cb8-50f5-4bb6-a532-639edec2c403 for instance e437667e-27e0-4c28-8bbd-206763b7d3bb on hv-cinder-86020 Oct 06 11:15:40.441972 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-20adec6f-2c7d-4fb1-9cbc-9dce066fea62 req-90d2e062-13ac-470e-a78c-b5a438c89753 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045458 Oct 06 11:15:40.443109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 522/1036] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:15:40.645232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d048f1c3-8fe6-4ebc-a6c7-326775247db5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:40.657125 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d048f1c3-8fe6-4ebc-a6c7-326775247db5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1367 microversion: 2.1 time: 0.282929 Oct 06 11:15:40.662091 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 515/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:40 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:41.685992 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8249c15-b87c-42fd-88d3-4a1d5f0a7241 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:41.687408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8249c15-b87c-42fd-88d3-4a1d5f0a7241 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:41.695411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8249c15-b87c-42fd-88d3-4a1d5f0a7241 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:41.697665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8249c15-b87c-42fd-88d3-4a1d5f0a7241 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:41.698185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8249c15-b87c-42fd-88d3-4a1d5f0a7241 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:41.698979 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8249c15-b87c-42fd-88d3-4a1d5f0a7241 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:41.699515 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8249c15-b87c-42fd-88d3-4a1d5f0a7241 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:41.700056 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8249c15-b87c-42fd-88d3-4a1d5f0a7241 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:41.847276 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a8249c15-b87c-42fd-88d3-4a1d5f0a7241 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:41.858383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8249c15-b87c-42fd-88d3-4a1d5f0a7241 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1367 microversion: 2.1 time: 0.178390 Oct 06 11:15:41.871860 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 523/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:41 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:42.882802 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ea5abbd0-b8e7-4270-b5bb-7a2f99cef01f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:42.883406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ea5abbd0-b8e7-4270-b5bb-7a2f99cef01f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:42.889281 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:42.891078 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea5abbd0-b8e7-4270-b5bb-7a2f99cef01f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:42.891641 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea5abbd0-b8e7-4270-b5bb-7a2f99cef01f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:42.892207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea5abbd0-b8e7-4270-b5bb-7a2f99cef01f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:42.893135 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea5abbd0-b8e7-4270-b5bb-7a2f99cef01f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:42.893761 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea5abbd0-b8e7-4270-b5bb-7a2f99cef01f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:42.894360 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea5abbd0-b8e7-4270-b5bb-7a2f99cef01f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:42.912229 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=77 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:43.045131 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea5abbd0-b8e7-4270-b5bb-7a2f99cef01f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:43.053094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ea5abbd0-b8e7-4270-b5bb-7a2f99cef01f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1367 microversion: 2.1 time: 0.175232 Oct 06 11:15:43.054744 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 516/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:42 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:44.078957 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c7cc975-1554-42cf-ba26-698858316a8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:44.079569 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c7cc975-1554-42cf-ba26-698858316a8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:44.082453 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:44.091449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7cc975-1554-42cf-ba26-698858316a8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:44.091980 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7cc975-1554-42cf-ba26-698858316a8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:44.092419 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7cc975-1554-42cf-ba26-698858316a8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:44.093142 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7cc975-1554-42cf-ba26-698858316a8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:44.093599 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7cc975-1554-42cf-ba26-698858316a8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:44.101264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7cc975-1554-42cf-ba26-698858316a8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:44.356177 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c7cc975-1554-42cf-ba26-698858316a8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:44.369227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c7cc975-1554-42cf-ba26-698858316a8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1367 microversion: 2.1 time: 0.294216 Oct 06 11:15:44.379763 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 524/1040] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:44 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:45.400494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-87f78bf2-934c-42fd-b578-bf63f714db47 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:45.401120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-87f78bf2-934c-42fd-b578-bf63f714db47 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:45.407769 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87f78bf2-934c-42fd-b578-bf63f714db47 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:45.408293 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87f78bf2-934c-42fd-b578-bf63f714db47 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:45.408735 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87f78bf2-934c-42fd-b578-bf63f714db47 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:45.409436 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87f78bf2-934c-42fd-b578-bf63f714db47 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:45.409892 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87f78bf2-934c-42fd-b578-bf63f714db47 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:45.410324 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87f78bf2-934c-42fd-b578-bf63f714db47 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:45.542299 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-87f78bf2-934c-42fd-b578-bf63f714db47 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:45.549910 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-87f78bf2-934c-42fd-b578-bf63f714db47 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1367 microversion: 2.1 time: 0.154605 Oct 06 11:15:45.550483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 517/1041] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:45 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:46.499580 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9c710b55-1c3b-4cf9-a0d5-67c7fa970573 req-6a82ad8b-34f0-4d84-81d6-f3138ce8dfa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e437667e-27e0-4c28-8bbd-206763b7d3bb", "name": "network-vif-plugged", "status": "completed", "tag": "d4154cb8-50f5-4bb6-a532-639edec2c403"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:46.513570 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9c710b55-1c3b-4cf9-a0d5-67c7fa970573 req-6a82ad8b-34f0-4d84-81d6-f3138ce8dfa3 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:46.514284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9c710b55-1c3b-4cf9-a0d5-67c7fa970573 req-6a82ad8b-34f0-4d84-81d6-f3138ce8dfa3 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:46.514722 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9c710b55-1c3b-4cf9-a0d5-67c7fa970573 req-6a82ad8b-34f0-4d84-81d6-f3138ce8dfa3 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:46.528861 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9c710b55-1c3b-4cf9-a0d5-67c7fa970573 req-6a82ad8b-34f0-4d84-81d6-f3138ce8dfa3 service nova] Creating event network-vif-plugged:d4154cb8-50f5-4bb6-a532-639edec2c403 for instance e437667e-27e0-4c28-8bbd-206763b7d3bb on hv-cinder-86020 Oct 06 11:15:46.534670 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9c710b55-1c3b-4cf9-a0d5-67c7fa970573 req-6a82ad8b-34f0-4d84-81d6-f3138ce8dfa3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040021 Oct 06 11:15:46.535819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 525/1042] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:15:46.574024 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bdb30d55-cacc-48ee-88a6-cfb974f1df84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:46.574704 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bdb30d55-cacc-48ee-88a6-cfb974f1df84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:46.590741 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb30d55-cacc-48ee-88a6-cfb974f1df84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:46.591918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb30d55-cacc-48ee-88a6-cfb974f1df84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:46.593905 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb30d55-cacc-48ee-88a6-cfb974f1df84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:46.594857 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb30d55-cacc-48ee-88a6-cfb974f1df84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:46.596271 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb30d55-cacc-48ee-88a6-cfb974f1df84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:46.598512 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdb30d55-cacc-48ee-88a6-cfb974f1df84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:46.867899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bdb30d55-cacc-48ee-88a6-cfb974f1df84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:46.881040 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bdb30d55-cacc-48ee-88a6-cfb974f1df84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1367 microversion: 2.1 time: 0.311769 Oct 06 11:15:46.885077 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 518/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:46 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:47.910515 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99bbf5aa-676f-4d8a-9aad-a544e44866e1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:47.911289 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99bbf5aa-676f-4d8a-9aad-a544e44866e1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:47.938264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:47.939342 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:47.945101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99bbf5aa-676f-4d8a-9aad-a544e44866e1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:47.945925 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99bbf5aa-676f-4d8a-9aad-a544e44866e1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:47.946307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99bbf5aa-676f-4d8a-9aad-a544e44866e1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:47.948326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99bbf5aa-676f-4d8a-9aad-a544e44866e1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:47.950816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99bbf5aa-676f-4d8a-9aad-a544e44866e1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:47.951289 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99bbf5aa-676f-4d8a-9aad-a544e44866e1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:48.192374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-99bbf5aa-676f-4d8a-9aad-a544e44866e1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:48.202184 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99bbf5aa-676f-4d8a-9aad-a544e44866e1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1367 microversion: 2.1 time: 0.297873 Oct 06 11:15:48.203384 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 526/1044] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:47 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:49.226445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b087160f-d188-45f2-a36d-3fae6d152663 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:49.227309 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b087160f-d188-45f2-a36d-3fae6d152663 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:49.229455 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:49.235814 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b087160f-d188-45f2-a36d-3fae6d152663 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:49.236470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b087160f-d188-45f2-a36d-3fae6d152663 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:49.237022 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b087160f-d188-45f2-a36d-3fae6d152663 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:49.237838 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b087160f-d188-45f2-a36d-3fae6d152663 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:49.238407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b087160f-d188-45f2-a36d-3fae6d152663 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:49.238940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b087160f-d188-45f2-a36d-3fae6d152663 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:49.400774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b087160f-d188-45f2-a36d-3fae6d152663 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:15:49.409298 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b087160f-d188-45f2-a36d-3fae6d152663 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1556 microversion: 2.1 time: 0.187383 Oct 06 11:15:49.409881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 519/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:15:49 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:15:49.438552 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-76f804f3-5e99-4935-9ea9-6b03187b1014 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:15:49.439071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-76f804f3-5e99-4935-9ea9-6b03187b1014 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:15:49.446281 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f804f3-5e99-4935-9ea9-6b03187b1014 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:49.446765 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f804f3-5e99-4935-9ea9-6b03187b1014 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:49.447377 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f804f3-5e99-4935-9ea9-6b03187b1014 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:49.448101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f804f3-5e99-4935-9ea9-6b03187b1014 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:49.448561 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f804f3-5e99-4935-9ea9-6b03187b1014 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:49.448988 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f804f3-5e99-4935-9ea9-6b03187b1014 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:49.533906 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-76f804f3-5e99-4935-9ea9-6b03187b1014 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105229 Oct 06 11:15:49.535037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 527/1046] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Oct 6 11:15:49 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:15:50.625310 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-fe29b011-21c0-4830-85f5-c0ec794903bf req-11b11edf-ff40-4486-a4e5-6bbb73a3cf56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e437667e-27e0-4c28-8bbd-206763b7d3bb", "tag": "d4154cb8-50f5-4bb6-a532-639edec2c403"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:50.636874 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fe29b011-21c0-4830-85f5-c0ec794903bf req-11b11edf-ff40-4486-a4e5-6bbb73a3cf56 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:15:50.637657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fe29b011-21c0-4830-85f5-c0ec794903bf req-11b11edf-ff40-4486-a4e5-6bbb73a3cf56 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:15:50.638249 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fe29b011-21c0-4830-85f5-c0ec794903bf req-11b11edf-ff40-4486-a4e5-6bbb73a3cf56 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:15:50.651206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-fe29b011-21c0-4830-85f5-c0ec794903bf req-11b11edf-ff40-4486-a4e5-6bbb73a3cf56 service nova] Creating event network-changed:d4154cb8-50f5-4bb6-a532-639edec2c403 for instance e437667e-27e0-4c28-8bbd-206763b7d3bb on hv-cinder-86020 Oct 06 11:15:50.656354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-fe29b011-21c0-4830-85f5-c0ec794903bf req-11b11edf-ff40-4486-a4e5-6bbb73a3cf56 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035382 Oct 06 11:15:50.656961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 520/1047] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:15:59.732483 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:59.733619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=28 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:59.898905 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df44431e-ccc8-47e2-93aa-e79118f6477d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Action: 'create', calling method: .version_select at 0x7f92a725ed30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1768988469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8qF1gZ0BOtl6X80qvjTExykLD7niN5m44tULWK2kVaZFWXJLp/KF1kIkPTYkwsXW26FGEr/3KXlhw9bFF7zjSsgBTbEMlPSe5zrzqAemRmTHpM7QAeTp5BSpfeSECrVA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:15:59.920137 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-df44431e-ccc8-47e2-93aa-e79118f6477d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Getting quotas for project 0934343645484d01b9b48a40bbf0b671. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:15:59.926633 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-df44431e-ccc8-47e2-93aa-e79118f6477d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Getting quotas for user acf06fe641e94b5b91145ed230ac7213 and project 0934343645484d01b9b48a40bbf0b671. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:15:59.956251 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df44431e-ccc8-47e2-93aa-e79118f6477d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.224959 Oct 06 11:15:59.957210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 528/1048] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Oct 6 11:15:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:16:24.679321 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-570550943", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1768988469", "security_groups": [{"name": "tempest-secgroup-smoke-516401855"}], "block_device_mapping_v2": [{"uuid": "0aa58a74-4942-4910-b566-d4416875da93", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4328977c-615f-4aaa-a450-a9014d5b4970"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:16:24.690208 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=9 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:24.690848 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=25 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:24.795831 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] validate_networks() for [('4328977c-615f-4aaa-a450-a9014d5b4970', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:16:25.162124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:16:25.162545 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:16:25.163014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:16:25.163420 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:16:25.163826 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:16:25.173127 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:25.173535 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:25.173966 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:25.174802 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:25.175250 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:25.175660 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:25.191914 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Getting quotas for project 0934343645484d01b9b48a40bbf0b671. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:16:25.195853 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Getting quotas for user acf06fe641e94b5b91145ed230ac7213 and project 0934343645484d01b9b48a40bbf0b671. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:16:25.252027 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:16:25.254216 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0aa58a74-4942-4910-b566-d4416875da93',volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:16:25.381484 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-56a83e9c-567c-4f30-aee3-d98dc6981796 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.706382 Oct 06 11:16:25.382132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 521/1049] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:16:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:16:25.392097 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:25.393414 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:25.399670 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9c5aedf-5259-43a8-835b-e9074c62456d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:25.400340 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9c5aedf-5259-43a8-835b-e9074c62456d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:25.457608 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c9c5aedf-5259-43a8-835b-e9074c62456d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:25.464482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9c5aedf-5259-43a8-835b-e9074c62456d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1094 microversion: 2.1 time: 0.074373 Oct 06 11:16:25.465881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 529/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:25 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:26.489539 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-476aa851-5ad1-4015-8154-9cc405f58909 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:26.490161 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-476aa851-5ad1-4015-8154-9cc405f58909 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:26.498433 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476aa851-5ad1-4015-8154-9cc405f58909 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:26.498921 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476aa851-5ad1-4015-8154-9cc405f58909 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:26.499563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476aa851-5ad1-4015-8154-9cc405f58909 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:26.500310 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476aa851-5ad1-4015-8154-9cc405f58909 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:26.500902 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476aa851-5ad1-4015-8154-9cc405f58909 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:26.501352 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476aa851-5ad1-4015-8154-9cc405f58909 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:26.570835 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-476aa851-5ad1-4015-8154-9cc405f58909 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:26.580827 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-476aa851-5ad1-4015-8154-9cc405f58909 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1200 microversion: 2.1 time: 0.095758 Oct 06 11:16:26.581867 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 522/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:26 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1200 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:27.605161 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e39ccdc-1c1a-4d0e-a4ba-613380fb27b2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:27.605786 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e39ccdc-1c1a-4d0e-a4ba-613380fb27b2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:27.613105 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e39ccdc-1c1a-4d0e-a4ba-613380fb27b2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:27.613601 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e39ccdc-1c1a-4d0e-a4ba-613380fb27b2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:27.614180 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e39ccdc-1c1a-4d0e-a4ba-613380fb27b2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:27.614905 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e39ccdc-1c1a-4d0e-a4ba-613380fb27b2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:27.615559 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e39ccdc-1c1a-4d0e-a4ba-613380fb27b2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:27.615903 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e39ccdc-1c1a-4d0e-a4ba-613380fb27b2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:27.851280 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3e39ccdc-1c1a-4d0e-a4ba-613380fb27b2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:27.859646 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e39ccdc-1c1a-4d0e-a4ba-613380fb27b2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.258321 Oct 06 11:16:27.860247 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 530/1052] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:27 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:27.993940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2ea89553-8e37-48b5-ab71-d9d1be28a068 req-f1fa5943-752c-48ff-a59b-ff6860d47de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847a7542-8658-4e05-85d3-98b8ceb6c9de", "tag": "9f6fca2b-eaa7-4e9e-9cb7-a301ae5992e4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:16:28.005098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2ea89553-8e37-48b5-ab71-d9d1be28a068 req-f1fa5943-752c-48ff-a59b-ff6860d47de0 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:28.005573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2ea89553-8e37-48b5-ab71-d9d1be28a068 req-f1fa5943-752c-48ff-a59b-ff6860d47de0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:28.006087 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2ea89553-8e37-48b5-ab71-d9d1be28a068 req-f1fa5943-752c-48ff-a59b-ff6860d47de0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:28.018231 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2ea89553-8e37-48b5-ab71-d9d1be28a068 req-f1fa5943-752c-48ff-a59b-ff6860d47de0 service nova] Creating event network-changed:9f6fca2b-eaa7-4e9e-9cb7-a301ae5992e4 for instance 847a7542-8658-4e05-85d3-98b8ceb6c9de on hv-cinder-86020 Oct 06 11:16:28.023380 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2ea89553-8e37-48b5-ab71-d9d1be28a068 req-f1fa5943-752c-48ff-a59b-ff6860d47de0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033176 Oct 06 11:16:28.024131 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 523/1053] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:16:28.883974 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0132c93-fd59-4831-8a29-aa34cf185e23 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:28.884661 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0132c93-fd59-4831-8a29-aa34cf185e23 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:28.891715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0132c93-fd59-4831-8a29-aa34cf185e23 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:28.892256 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0132c93-fd59-4831-8a29-aa34cf185e23 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:28.892703 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0132c93-fd59-4831-8a29-aa34cf185e23 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:28.893409 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0132c93-fd59-4831-8a29-aa34cf185e23 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:28.893870 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0132c93-fd59-4831-8a29-aa34cf185e23 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:28.894300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0132c93-fd59-4831-8a29-aa34cf185e23 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:29.025267 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e0132c93-fd59-4831-8a29-aa34cf185e23 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:29.033975 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0132c93-fd59-4831-8a29-aa34cf185e23 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.153902 Oct 06 11:16:29.034593 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 531/1054] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:28 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:30.058112 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-311263e1-cd18-44d8-9217-256469352aae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:30.058803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-311263e1-cd18-44d8-9217-256469352aae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:30.065248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311263e1-cd18-44d8-9217-256469352aae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:30.065730 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311263e1-cd18-44d8-9217-256469352aae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:30.066167 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311263e1-cd18-44d8-9217-256469352aae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:30.066863 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311263e1-cd18-44d8-9217-256469352aae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:30.067316 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311263e1-cd18-44d8-9217-256469352aae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:30.067754 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311263e1-cd18-44d8-9217-256469352aae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:30.217384 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-311263e1-cd18-44d8-9217-256469352aae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:30.225148 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-311263e1-cd18-44d8-9217-256469352aae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.171800 Oct 06 11:16:30.226763 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 524/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:30 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:31.253055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9cdf75c3-36c7-4726-8c80-1c085bd8b2bb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:31.253715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9cdf75c3-36c7-4726-8c80-1c085bd8b2bb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:31.260148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf75c3-36c7-4726-8c80-1c085bd8b2bb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:31.260639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf75c3-36c7-4726-8c80-1c085bd8b2bb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:31.261114 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf75c3-36c7-4726-8c80-1c085bd8b2bb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:31.261819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf75c3-36c7-4726-8c80-1c085bd8b2bb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:31.262279 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf75c3-36c7-4726-8c80-1c085bd8b2bb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:31.262747 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cdf75c3-36c7-4726-8c80-1c085bd8b2bb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:31.390395 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9cdf75c3-36c7-4726-8c80-1c085bd8b2bb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:31.398540 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9cdf75c3-36c7-4726-8c80-1c085bd8b2bb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.149602 Oct 06 11:16:31.399122 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 532/1056] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:31 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:32.421399 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc8aef0e-122e-4477-9c2d-9f505b558d39 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:32.422009 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc8aef0e-122e-4477-9c2d-9f505b558d39 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:32.428399 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8aef0e-122e-4477-9c2d-9f505b558d39 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:32.428882 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8aef0e-122e-4477-9c2d-9f505b558d39 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:32.429313 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8aef0e-122e-4477-9c2d-9f505b558d39 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:32.429995 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8aef0e-122e-4477-9c2d-9f505b558d39 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:32.430445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8aef0e-122e-4477-9c2d-9f505b558d39 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:32.430866 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8aef0e-122e-4477-9c2d-9f505b558d39 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:32.558115 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-dc8aef0e-122e-4477-9c2d-9f505b558d39 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:32.566788 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc8aef0e-122e-4477-9c2d-9f505b558d39 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.149276 Oct 06 11:16:32.567349 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 525/1057] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:32 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:33.590622 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9d37d0b-761e-404b-9a87-ea7351e0760d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:33.592095 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e9d37d0b-761e-404b-9a87-ea7351e0760d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:33.598278 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d37d0b-761e-404b-9a87-ea7351e0760d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:33.598761 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d37d0b-761e-404b-9a87-ea7351e0760d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:33.599194 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d37d0b-761e-404b-9a87-ea7351e0760d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:33.599915 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d37d0b-761e-404b-9a87-ea7351e0760d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:33.600370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d37d0b-761e-404b-9a87-ea7351e0760d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:33.600792 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d37d0b-761e-404b-9a87-ea7351e0760d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:33.730764 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e9d37d0b-761e-404b-9a87-ea7351e0760d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:33.738546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e9d37d0b-761e-404b-9a87-ea7351e0760d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.151828 Oct 06 11:16:33.739243 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 533/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:33 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:34.760702 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-21692c09-3909-4ceb-a4ab-7ccffc3bfbbe tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:34.761311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-21692c09-3909-4ceb-a4ab-7ccffc3bfbbe tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:34.767650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21692c09-3909-4ceb-a4ab-7ccffc3bfbbe tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:34.768242 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21692c09-3909-4ceb-a4ab-7ccffc3bfbbe tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:34.768675 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21692c09-3909-4ceb-a4ab-7ccffc3bfbbe tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:34.769366 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21692c09-3909-4ceb-a4ab-7ccffc3bfbbe tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:34.769817 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21692c09-3909-4ceb-a4ab-7ccffc3bfbbe tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:34.770240 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21692c09-3909-4ceb-a4ab-7ccffc3bfbbe tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:34.898505 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-21692c09-3909-4ceb-a4ab-7ccffc3bfbbe tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:34.907155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-21692c09-3909-4ceb-a4ab-7ccffc3bfbbe tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.150242 Oct 06 11:16:34.907663 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 526/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:34 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:35.930136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ba8a3e17-3928-496d-a573-320dcdff80ae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:35.930746 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ba8a3e17-3928-496d-a573-320dcdff80ae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:35.933095 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:35.939172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a3e17-3928-496d-a573-320dcdff80ae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:35.939659 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a3e17-3928-496d-a573-320dcdff80ae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:35.940136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a3e17-3928-496d-a573-320dcdff80ae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:35.940826 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a3e17-3928-496d-a573-320dcdff80ae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:35.941278 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a3e17-3928-496d-a573-320dcdff80ae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:35.941699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a3e17-3928-496d-a573-320dcdff80ae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:36.078410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba8a3e17-3928-496d-a573-320dcdff80ae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:36.086116 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ba8a3e17-3928-496d-a573-320dcdff80ae tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.159924 Oct 06 11:16:36.086691 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 534/1060] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:35 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:37.107191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:37.107991 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:37.112617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6a03486-c6b2-4ef4-b5ee-535c7d2ab30e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:37.113241 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a6a03486-c6b2-4ef4-b5ee-535c7d2ab30e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:37.120811 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a03486-c6b2-4ef4-b5ee-535c7d2ab30e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:37.121365 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a03486-c6b2-4ef4-b5ee-535c7d2ab30e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:37.122422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a03486-c6b2-4ef4-b5ee-535c7d2ab30e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:37.123337 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a03486-c6b2-4ef4-b5ee-535c7d2ab30e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:37.123829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a03486-c6b2-4ef4-b5ee-535c7d2ab30e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:37.124404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a03486-c6b2-4ef4-b5ee-535c7d2ab30e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:37.264254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a6a03486-c6b2-4ef4-b5ee-535c7d2ab30e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:37.272231 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6a03486-c6b2-4ef4-b5ee-535c7d2ab30e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.165790 Oct 06 11:16:37.272800 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 527/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:37 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:38.295046 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dddedad8-5e84-45d9-94d4-c5e75c90f9c8 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:38.295662 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dddedad8-5e84-45d9-94d4-c5e75c90f9c8 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:38.302211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddedad8-5e84-45d9-94d4-c5e75c90f9c8 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:38.302701 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddedad8-5e84-45d9-94d4-c5e75c90f9c8 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:38.303141 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddedad8-5e84-45d9-94d4-c5e75c90f9c8 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:38.303868 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddedad8-5e84-45d9-94d4-c5e75c90f9c8 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:38.304326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddedad8-5e84-45d9-94d4-c5e75c90f9c8 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:38.304755 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddedad8-5e84-45d9-94d4-c5e75c90f9c8 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:38.432269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dddedad8-5e84-45d9-94d4-c5e75c90f9c8 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:38.440747 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dddedad8-5e84-45d9-94d4-c5e75c90f9c8 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.149720 Oct 06 11:16:38.441316 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 535/1062] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:38 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:38.758846 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-285d7fa0-2bed-428e-90a7-f3d97d26c646 req-cf079aa2-0634-4dde-872c-57f2d10013fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847a7542-8658-4e05-85d3-98b8ceb6c9de", "name": "network-vif-plugged", "status": "completed", "tag": "9f6fca2b-eaa7-4e9e-9cb7-a301ae5992e4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:16:38.768989 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-285d7fa0-2bed-428e-90a7-f3d97d26c646 req-cf079aa2-0634-4dde-872c-57f2d10013fd service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:38.769656 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-285d7fa0-2bed-428e-90a7-f3d97d26c646 req-cf079aa2-0634-4dde-872c-57f2d10013fd service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:38.769978 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-285d7fa0-2bed-428e-90a7-f3d97d26c646 req-cf079aa2-0634-4dde-872c-57f2d10013fd service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:38.782667 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-285d7fa0-2bed-428e-90a7-f3d97d26c646 req-cf079aa2-0634-4dde-872c-57f2d10013fd service nova] Creating event network-vif-plugged:9f6fca2b-eaa7-4e9e-9cb7-a301ae5992e4 for instance 847a7542-8658-4e05-85d3-98b8ceb6c9de on hv-cinder-86020 Oct 06 11:16:38.787636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-285d7fa0-2bed-428e-90a7-f3d97d26c646 req-cf079aa2-0634-4dde-872c-57f2d10013fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092728 Oct 06 11:16:38.788289 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 528/1063] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:16:39.463954 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-305a19cf-577f-417a-b9f0-8f1bccd662f0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:39.464568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-305a19cf-577f-417a-b9f0-8f1bccd662f0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:39.471000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305a19cf-577f-417a-b9f0-8f1bccd662f0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:39.471479 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305a19cf-577f-417a-b9f0-8f1bccd662f0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:39.472013 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305a19cf-577f-417a-b9f0-8f1bccd662f0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:39.472702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305a19cf-577f-417a-b9f0-8f1bccd662f0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:39.473153 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305a19cf-577f-417a-b9f0-8f1bccd662f0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:39.473574 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305a19cf-577f-417a-b9f0-8f1bccd662f0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:39.601104 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-305a19cf-577f-417a-b9f0-8f1bccd662f0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:39.609667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-305a19cf-577f-417a-b9f0-8f1bccd662f0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.149646 Oct 06 11:16:39.610241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 536/1064] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:39 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:40.634635 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ce16a8ab-6fac-4a1e-95ae-4866c23542e1 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:40.635338 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ce16a8ab-6fac-4a1e-95ae-4866c23542e1 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:40.642330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce16a8ab-6fac-4a1e-95ae-4866c23542e1 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:40.642753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce16a8ab-6fac-4a1e-95ae-4866c23542e1 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:40.643190 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce16a8ab-6fac-4a1e-95ae-4866c23542e1 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:40.643944 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce16a8ab-6fac-4a1e-95ae-4866c23542e1 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:40.644408 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce16a8ab-6fac-4a1e-95ae-4866c23542e1 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:40.644836 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce16a8ab-6fac-4a1e-95ae-4866c23542e1 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:40.777618 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-ce16a8ab-6fac-4a1e-95ae-4866c23542e1 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:40.785989 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ce16a8ab-6fac-4a1e-95ae-4866c23542e1 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1265 microversion: 2.1 time: 0.155917 Oct 06 11:16:40.786590 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 529/1065] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:40 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:41.809306 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-46c141ff-3ac9-4b00-a9e7-f5b8670d09a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:41.809951 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46c141ff-3ac9-4b00-a9e7-f5b8670d09a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:41.816899 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46c141ff-3ac9-4b00-a9e7-f5b8670d09a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:41.817399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46c141ff-3ac9-4b00-a9e7-f5b8670d09a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:41.817843 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46c141ff-3ac9-4b00-a9e7-f5b8670d09a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:41.818554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46c141ff-3ac9-4b00-a9e7-f5b8670d09a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:41.819058 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46c141ff-3ac9-4b00-a9e7-f5b8670d09a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:41.819478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46c141ff-3ac9-4b00-a9e7-f5b8670d09a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:41.956062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-46c141ff-3ac9-4b00-a9e7-f5b8670d09a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:41.964128 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-46c141ff-3ac9-4b00-a9e7-f5b8670d09a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1452 microversion: 2.1 time: 0.158798 Oct 06 11:16:41.964691 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 537/1066] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:41 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:41.986717 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-df3186e4-9300-4809-b977-470c2812f7b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:16:41.987332 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-df3186e4-9300-4809-b977-470c2812f7b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:16:41.993675 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df3186e4-9300-4809-b977-470c2812f7b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:41.994157 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df3186e4-9300-4809-b977-470c2812f7b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:41.994594 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df3186e4-9300-4809-b977-470c2812f7b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:41.995286 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df3186e4-9300-4809-b977-470c2812f7b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:41.995736 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df3186e4-9300-4809-b977-470c2812f7b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:41.996186 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df3186e4-9300-4809-b977-470c2812f7b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:42.129704 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-df3186e4-9300-4809-b977-470c2812f7b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:16:42.138677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-df3186e4-9300-4809-b977-470c2812f7b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1452 microversion: 2.1 time: 0.154698 Oct 06 11:16:42.139251 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 530/1067] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:16:41 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:16:44.054493 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a6fb4018-305d-4a03-8791-0dd6960355f1 req-46a55e2b-ca19-4cfa-a6db-9308877448df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847a7542-8658-4e05-85d3-98b8ceb6c9de", "tag": "9f6fca2b-eaa7-4e9e-9cb7-a301ae5992e4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:16:44.064722 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6fb4018-305d-4a03-8791-0dd6960355f1 req-46a55e2b-ca19-4cfa-a6db-9308877448df service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:16:44.065205 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6fb4018-305d-4a03-8791-0dd6960355f1 req-46a55e2b-ca19-4cfa-a6db-9308877448df service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:16:44.065641 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6fb4018-305d-4a03-8791-0dd6960355f1 req-46a55e2b-ca19-4cfa-a6db-9308877448df service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:16:44.077255 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a6fb4018-305d-4a03-8791-0dd6960355f1 req-46a55e2b-ca19-4cfa-a6db-9308877448df service nova] Creating event network-changed:9f6fca2b-eaa7-4e9e-9cb7-a301ae5992e4 for instance 847a7542-8658-4e05-85d3-98b8ceb6c9de on hv-cinder-86020 Oct 06 11:16:44.082532 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a6fb4018-305d-4a03-8791-0dd6960355f1 req-46a55e2b-ca19-4cfa-a6db-9308877448df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031642 Oct 06 11:16:44.083130 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 538/1068] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:17:09.096004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2cfb58c0-fcf8-408f-a0e9-be7366f88998 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:09.096624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2cfb58c0-fcf8-408f-a0e9-be7366f88998 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:09.098784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:09.099482 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=48 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:09.106085 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cfb58c0-fcf8-408f-a0e9-be7366f88998 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:09.106511 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cfb58c0-fcf8-408f-a0e9-be7366f88998 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:09.106942 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cfb58c0-fcf8-408f-a0e9-be7366f88998 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:09.107667 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cfb58c0-fcf8-408f-a0e9-be7366f88998 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:09.108144 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cfb58c0-fcf8-408f-a0e9-be7366f88998 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:09.108564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cfb58c0-fcf8-408f-a0e9-be7366f88998 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:09.134640 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2cfb58c0-fcf8-408f-a0e9-be7366f88998 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/ips" status: 200 len: 148 microversion: 2.1 time: 0.042980 Oct 06 11:17:09.135223 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 531/1069] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Oct 6 11:17:09 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:17:10.491913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc3ca2e5-d3c1-4e03-a02b-9a1ee181fb56 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b60860d-fb68-4764-93ee-fd81d60e8fc2"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:17:10.494338 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc3ca2e5-d3c1-4e03-a02b-9a1ee181fb56 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:10.496598 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=22 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:10.497238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=50 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:10.503001 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3ca2e5-d3c1-4e03-a02b-9a1ee181fb56 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:10.503484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3ca2e5-d3c1-4e03-a02b-9a1ee181fb56 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:10.503959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3ca2e5-d3c1-4e03-a02b-9a1ee181fb56 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:10.504653 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3ca2e5-d3c1-4e03-a02b-9a1ee181fb56 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:10.505105 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3ca2e5-d3c1-4e03-a02b-9a1ee181fb56 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:10.505527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3ca2e5-d3c1-4e03-a02b-9a1ee181fb56 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:10.764717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc3ca2e5-d3c1-4e03-a02b-9a1ee181fb56 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277097 Oct 06 11:17:10.765341 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 539/1070] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:17:10 2022] POST /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:17:14.161567 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19be05fb-26cb-4740-ba15-a35121749d1d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:17:14.162134 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-19be05fb-26cb-4740-ba15-a35121749d1d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:14.168500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19be05fb-26cb-4740-ba15-a35121749d1d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:14.168977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19be05fb-26cb-4740-ba15-a35121749d1d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:14.169409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19be05fb-26cb-4740-ba15-a35121749d1d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:14.170093 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19be05fb-26cb-4740-ba15-a35121749d1d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:14.170541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19be05fb-26cb-4740-ba15-a35121749d1d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:14.170959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19be05fb-26cb-4740-ba15-a35121749d1d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:14.193989 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-19be05fb-26cb-4740-ba15-a35121749d1d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lazy-loading 'flavor' on Instance uuid 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:17:14.265180 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19be05fb-26cb-4740-ba15-a35121749d1d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "POST /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8/action" status: 202 len: 0 microversion: 2.1 time: 0.107869 Oct 06 11:17:14.265794 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 532/1071] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:17:14 2022] POST /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 11:17:14.275719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9be3d227-f6d0-4d0e-ae96-eff716410dda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:14.276472 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9be3d227-f6d0-4d0e-ae96-eff716410dda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:14.283190 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be3d227-f6d0-4d0e-ae96-eff716410dda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:14.283811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be3d227-f6d0-4d0e-ae96-eff716410dda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:14.284309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be3d227-f6d0-4d0e-ae96-eff716410dda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:14.285023 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be3d227-f6d0-4d0e-ae96-eff716410dda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:14.285478 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be3d227-f6d0-4d0e-ae96-eff716410dda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:14.285912 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be3d227-f6d0-4d0e-ae96-eff716410dda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:14.426442 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9be3d227-f6d0-4d0e-ae96-eff716410dda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:14.434063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9be3d227-f6d0-4d0e-ae96-eff716410dda tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.163402 Oct 06 11:17:14.434626 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 540/1072] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:14 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:15.458093 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a71d835-fe03-4de7-ac0b-4a2198738bdc tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:15.458802 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a71d835-fe03-4de7-ac0b-4a2198738bdc tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:15.465409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a71d835-fe03-4de7-ac0b-4a2198738bdc tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:15.465894 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a71d835-fe03-4de7-ac0b-4a2198738bdc tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:15.466336 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a71d835-fe03-4de7-ac0b-4a2198738bdc tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:15.467033 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a71d835-fe03-4de7-ac0b-4a2198738bdc tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:15.467510 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a71d835-fe03-4de7-ac0b-4a2198738bdc tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:15.467986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a71d835-fe03-4de7-ac0b-4a2198738bdc tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:15.597579 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0a71d835-fe03-4de7-ac0b-4a2198738bdc tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:15.605201 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a71d835-fe03-4de7-ac0b-4a2198738bdc tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.151954 Oct 06 11:17:15.605767 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 533/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:15 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:16.629057 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-095922eb-d6fd-445a-a539-2d703561690c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:16.629700 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-095922eb-d6fd-445a-a539-2d703561690c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:16.636495 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095922eb-d6fd-445a-a539-2d703561690c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:16.636989 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095922eb-d6fd-445a-a539-2d703561690c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:16.637437 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095922eb-d6fd-445a-a539-2d703561690c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:16.638145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095922eb-d6fd-445a-a539-2d703561690c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:16.638601 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095922eb-d6fd-445a-a539-2d703561690c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:16.639029 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095922eb-d6fd-445a-a539-2d703561690c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:16.769363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-095922eb-d6fd-445a-a539-2d703561690c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:16.777302 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-095922eb-d6fd-445a-a539-2d703561690c tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.152396 Oct 06 11:17:16.777872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 541/1074] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:16 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:17.802571 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-175b44c3-6340-4137-b5ad-1481f2adfc6f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:17.803193 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-175b44c3-6340-4137-b5ad-1481f2adfc6f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:17.809544 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-175b44c3-6340-4137-b5ad-1481f2adfc6f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:17.810026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-175b44c3-6340-4137-b5ad-1481f2adfc6f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:17.810465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-175b44c3-6340-4137-b5ad-1481f2adfc6f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:17.811168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-175b44c3-6340-4137-b5ad-1481f2adfc6f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:17.811620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-175b44c3-6340-4137-b5ad-1481f2adfc6f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:17.812072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-175b44c3-6340-4137-b5ad-1481f2adfc6f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:17.946464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-175b44c3-6340-4137-b5ad-1481f2adfc6f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:17.955088 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-175b44c3-6340-4137-b5ad-1481f2adfc6f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.157512 Oct 06 11:17:17.955660 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 534/1075] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:17 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:18.299553 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a6569ba-3ca6-467d-9420-9f64eadf4560 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: .version_select at 0x7f92a6f140d0>, body: {"keypair": {"name": "tempest-keypair-35174386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZaKDzrBSm4+jVuyuf5xaAluSJmlniMMyy+YHTBRx3xT5AQ5nIIa4cWol2d7h50PgPbYXhgcw6jeRlxIsCeJf1UYX+rjVjYuoMGjJX5XSTT1xp5mLjp/MJzt64EdOBgrQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:17:18.315338 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-3a6569ba-3ca6-467d-9420-9f64eadf4560 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:17:18.319123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-3a6569ba-3ca6-467d-9420-9f64eadf4560 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for user 4ad5a3ee5ab545e2893d4f6365f8f939 and project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:17:18.341758 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a6569ba-3ca6-467d-9420-9f64eadf4560 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.046155 Oct 06 11:17:18.342353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 542/1076] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Oct 6 11:17:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:17:18.978930 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-75b7e926-9a6e-4bb5-a74a-093f186a7859 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:18.979546 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-75b7e926-9a6e-4bb5-a74a-093f186a7859 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:18.986086 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b7e926-9a6e-4bb5-a74a-093f186a7859 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:18.986745 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b7e926-9a6e-4bb5-a74a-093f186a7859 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:18.987183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b7e926-9a6e-4bb5-a74a-093f186a7859 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:18.987901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b7e926-9a6e-4bb5-a74a-093f186a7859 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:18.988360 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b7e926-9a6e-4bb5-a74a-093f186a7859 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:18.988784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b7e926-9a6e-4bb5-a74a-093f186a7859 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:19.209650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-75b7e926-9a6e-4bb5-a74a-093f186a7859 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:19.219276 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-75b7e926-9a6e-4bb5-a74a-093f186a7859 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.244285 Oct 06 11:17:19.219903 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 535/1077] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:18 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:19.676380 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1564920484", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d576013-5c41-470a-82ec-fbb07f6bd986"}], "security_groups": [{"name": "tempest-securitygroup--1389640474"}], "key_name": "tempest-keypair-35174386", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:17:19.777254 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] validate_networks() for [('8d576013-5c41-470a-82ec-fbb07f6bd986', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:17:20.137357 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:17:20.137826 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:17:20.138361 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:17:20.138805 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:17:20.139230 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:17:20.148888 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:20.149377 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:20.149816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:20.150554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:20.151017 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:20.151448 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:20.169206 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:17:20.173222 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for user 4ad5a3ee5ab545e2893d4f6365f8f939 and project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:17:20.184070 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:17:20.186335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:17:20.233769 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0307e04d-2eff-43b1-81c8-1e5e580fd4b7 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.562825 Oct 06 11:17:20.234420 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 543/1078] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:17:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:17:20.242306 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd8cc549-0726-48d4-84a9-e0e4c4a177a1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:20.243017 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd8cc549-0726-48d4-84a9-e0e4c4a177a1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:20.246546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd07385b-ba0b-4e38-ad32-96b5d2151ad5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:20.247261 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd07385b-ba0b-4e38-ad32-96b5d2151ad5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:20.249943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd8cc549-0726-48d4-84a9-e0e4c4a177a1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:20.250691 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd8cc549-0726-48d4-84a9-e0e4c4a177a1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:20.252072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd8cc549-0726-48d4-84a9-e0e4c4a177a1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:20.253055 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd8cc549-0726-48d4-84a9-e0e4c4a177a1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:20.253724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd8cc549-0726-48d4-84a9-e0e4c4a177a1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:20.254223 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd8cc549-0726-48d4-84a9-e0e4c4a177a1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:20.305470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd07385b-ba0b-4e38-ad32-96b5d2151ad5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:20.313103 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd07385b-ba0b-4e38-ad32-96b5d2151ad5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1240 microversion: 2.1 time: 0.070667 Oct 06 11:17:20.313796 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 544/1079] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:20 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:17:20.402338 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd8cc549-0726-48d4-84a9-e0e4c4a177a1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:20.410737 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd8cc549-0726-48d4-84a9-e0e4c4a177a1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.172257 Oct 06 11:17:20.411309 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 536/1080] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:20 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:21.336934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d00eebb0-ce87-4371-a6d9-5400cdb4613a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:21.337495 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d00eebb0-ce87-4371-a6d9-5400cdb4613a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:21.344981 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d00eebb0-ce87-4371-a6d9-5400cdb4613a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:21.345551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d00eebb0-ce87-4371-a6d9-5400cdb4613a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:21.345993 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d00eebb0-ce87-4371-a6d9-5400cdb4613a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:21.346724 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d00eebb0-ce87-4371-a6d9-5400cdb4613a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:21.347717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d00eebb0-ce87-4371-a6d9-5400cdb4613a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:21.348203 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d00eebb0-ce87-4371-a6d9-5400cdb4613a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:21.431968 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d00eebb0-ce87-4371-a6d9-5400cdb4613a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:21.433931 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-454a157f-f09f-402d-87d3-72fcacadfe47 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:21.434580 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-454a157f-f09f-402d-87d3-72fcacadfe47 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:21.442460 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454a157f-f09f-402d-87d3-72fcacadfe47 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:21.442826 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d00eebb0-ce87-4371-a6d9-5400cdb4613a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1300 microversion: 2.1 time: 0.110472 Oct 06 11:17:21.443268 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454a157f-f09f-402d-87d3-72fcacadfe47 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:21.443546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 545/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:21 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:21.455946 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454a157f-f09f-402d-87d3-72fcacadfe47 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:21.455946 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454a157f-f09f-402d-87d3-72fcacadfe47 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:21.455946 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454a157f-f09f-402d-87d3-72fcacadfe47 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:21.455946 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454a157f-f09f-402d-87d3-72fcacadfe47 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:21.586157 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-454a157f-f09f-402d-87d3-72fcacadfe47 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:21.594171 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-454a157f-f09f-402d-87d3-72fcacadfe47 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.164013 Oct 06 11:17:21.594671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 537/1082] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:21 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:17:22.471021 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5ff1ebb-dd31-4a77-bfd5-99fef1541ff8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:22.471566 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5ff1ebb-dd31-4a77-bfd5-99fef1541ff8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:22.477918 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5ff1ebb-dd31-4a77-bfd5-99fef1541ff8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:22.478396 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5ff1ebb-dd31-4a77-bfd5-99fef1541ff8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:22.478834 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5ff1ebb-dd31-4a77-bfd5-99fef1541ff8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:22.479530 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5ff1ebb-dd31-4a77-bfd5-99fef1541ff8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:22.480086 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5ff1ebb-dd31-4a77-bfd5-99fef1541ff8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:22.480509 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5ff1ebb-dd31-4a77-bfd5-99fef1541ff8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:22.617311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7fa2881-e2f2-46b1-8565-9ebe81952ce0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:22.617921 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7fa2881-e2f2-46b1-8565-9ebe81952ce0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:22.624431 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7fa2881-e2f2-46b1-8565-9ebe81952ce0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:22.624915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7fa2881-e2f2-46b1-8565-9ebe81952ce0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:22.625349 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7fa2881-e2f2-46b1-8565-9ebe81952ce0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:22.626707 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7fa2881-e2f2-46b1-8565-9ebe81952ce0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:22.627329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7fa2881-e2f2-46b1-8565-9ebe81952ce0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:22.627887 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7fa2881-e2f2-46b1-8565-9ebe81952ce0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:22.689259 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5ff1ebb-dd31-4a77-bfd5-99fef1541ff8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:22.698853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5ff1ebb-dd31-4a77-bfd5-99fef1541ff8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1366 microversion: 2.1 time: 0.231855 Oct 06 11:17:22.699542 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 546/1083] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:22 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:22.784412 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7fa2881-e2f2-46b1-8565-9ebe81952ce0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:22.792217 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7fa2881-e2f2-46b1-8565-9ebe81952ce0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.178897 Oct 06 11:17:22.793949 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 538/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:22 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:17:22.953499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9187fd4f-f853-48c6-b07d-b7335373885e req-d020e289-3b44-493c-9a80-1addd72f014b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65604ed1-1c1e-4050-b0f1-821dcd37a862", "tag": "704b0c2d-ea1f-4607-8dfa-0f321f1b5467"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:17:22.962966 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9187fd4f-f853-48c6-b07d-b7335373885e req-d020e289-3b44-493c-9a80-1addd72f014b service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:22.963451 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9187fd4f-f853-48c6-b07d-b7335373885e req-d020e289-3b44-493c-9a80-1addd72f014b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:22.963918 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9187fd4f-f853-48c6-b07d-b7335373885e req-d020e289-3b44-493c-9a80-1addd72f014b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:22.974901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9187fd4f-f853-48c6-b07d-b7335373885e req-d020e289-3b44-493c-9a80-1addd72f014b service nova] Creating event network-changed:704b0c2d-ea1f-4607-8dfa-0f321f1b5467 for instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 on hv-cinder-86020 Oct 06 11:17:22.979938 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9187fd4f-f853-48c6-b07d-b7335373885e req-d020e289-3b44-493c-9a80-1addd72f014b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030046 Oct 06 11:17:22.980625 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 547/1085] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:17:23.723158 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5fd46c43-e0d2-4ead-9f43-2f0aafc60db3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:23.723780 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5fd46c43-e0d2-4ead-9f43-2f0aafc60db3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:23.730170 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fd46c43-e0d2-4ead-9f43-2f0aafc60db3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:23.730649 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fd46c43-e0d2-4ead-9f43-2f0aafc60db3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:23.731082 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fd46c43-e0d2-4ead-9f43-2f0aafc60db3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:23.731774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fd46c43-e0d2-4ead-9f43-2f0aafc60db3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:23.732253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fd46c43-e0d2-4ead-9f43-2f0aafc60db3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:23.732672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fd46c43-e0d2-4ead-9f43-2f0aafc60db3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:23.818975 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94aa1dbf-93bc-40f1-bde5-ccd04f5d9227 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:23.819827 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94aa1dbf-93bc-40f1-bde5-ccd04f5d9227 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:23.826816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94aa1dbf-93bc-40f1-bde5-ccd04f5d9227 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:23.827578 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94aa1dbf-93bc-40f1-bde5-ccd04f5d9227 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:23.828056 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94aa1dbf-93bc-40f1-bde5-ccd04f5d9227 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:23.828787 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94aa1dbf-93bc-40f1-bde5-ccd04f5d9227 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:23.829826 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94aa1dbf-93bc-40f1-bde5-ccd04f5d9227 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:23.830286 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94aa1dbf-93bc-40f1-bde5-ccd04f5d9227 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:23.869705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5fd46c43-e0d2-4ead-9f43-2f0aafc60db3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:23.877831 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5fd46c43-e0d2-4ead-9f43-2f0aafc60db3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1366 microversion: 2.1 time: 0.159094 Oct 06 11:17:23.878679 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 539/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:23 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:24.134829 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-94aa1dbf-93bc-40f1-bde5-ccd04f5d9227 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:24.143372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94aa1dbf-93bc-40f1-bde5-ccd04f5d9227 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.329342 Oct 06 11:17:24.143974 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 548/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:23 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:17:24.901475 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c4cfc8c-86d3-4823-ba08-661d403646b8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:24.902072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c4cfc8c-86d3-4823-ba08-661d403646b8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:24.909057 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4cfc8c-86d3-4823-ba08-661d403646b8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:24.909532 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4cfc8c-86d3-4823-ba08-661d403646b8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:24.909964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4cfc8c-86d3-4823-ba08-661d403646b8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:24.910648 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4cfc8c-86d3-4823-ba08-661d403646b8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:24.911095 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4cfc8c-86d3-4823-ba08-661d403646b8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:24.911515 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4cfc8c-86d3-4823-ba08-661d403646b8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:25.046948 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c4cfc8c-86d3-4823-ba08-661d403646b8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:25.054587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c4cfc8c-86d3-4823-ba08-661d403646b8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1366 microversion: 2.1 time: 0.156982 Oct 06 11:17:25.055151 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 540/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:24 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:25.167113 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b83437b4-6fb8-4d69-94e1-11dd96837444 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:25.167650 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b83437b4-6fb8-4d69-94e1-11dd96837444 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:25.174173 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83437b4-6fb8-4d69-94e1-11dd96837444 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:25.174670 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83437b4-6fb8-4d69-94e1-11dd96837444 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:25.175113 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83437b4-6fb8-4d69-94e1-11dd96837444 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:25.175814 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83437b4-6fb8-4d69-94e1-11dd96837444 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:25.176302 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83437b4-6fb8-4d69-94e1-11dd96837444 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:25.176736 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83437b4-6fb8-4d69-94e1-11dd96837444 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:25.311304 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b83437b4-6fb8-4d69-94e1-11dd96837444 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:25.319234 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b83437b4-6fb8-4d69-94e1-11dd96837444 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.156004 Oct 06 11:17:25.319799 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 549/1089] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:25 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:26.076163 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-15092d50-3b96-444f-885c-cc5d9a3ace40 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:26.076775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-15092d50-3b96-444f-885c-cc5d9a3ace40 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:26.083299 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15092d50-3b96-444f-885c-cc5d9a3ace40 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:26.083779 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15092d50-3b96-444f-885c-cc5d9a3ace40 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:26.084259 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15092d50-3b96-444f-885c-cc5d9a3ace40 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:26.084947 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15092d50-3b96-444f-885c-cc5d9a3ace40 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:26.085394 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15092d50-3b96-444f-885c-cc5d9a3ace40 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:26.085818 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15092d50-3b96-444f-885c-cc5d9a3ace40 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:26.215546 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-15092d50-3b96-444f-885c-cc5d9a3ace40 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:26.223647 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-15092d50-3b96-444f-885c-cc5d9a3ace40 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1366 microversion: 2.1 time: 0.151428 Oct 06 11:17:26.224248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 541/1090] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:26 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:26.342467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f096f3be-5307-4fc1-89c1-412e4e6a48c7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:26.343088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f096f3be-5307-4fc1-89c1-412e4e6a48c7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:26.350660 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f096f3be-5307-4fc1-89c1-412e4e6a48c7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:26.351151 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f096f3be-5307-4fc1-89c1-412e4e6a48c7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:26.351595 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f096f3be-5307-4fc1-89c1-412e4e6a48c7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:26.352325 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f096f3be-5307-4fc1-89c1-412e4e6a48c7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:26.352812 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f096f3be-5307-4fc1-89c1-412e4e6a48c7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:26.353262 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f096f3be-5307-4fc1-89c1-412e4e6a48c7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:26.583307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f096f3be-5307-4fc1-89c1-412e4e6a48c7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:26.591318 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f096f3be-5307-4fc1-89c1-412e4e6a48c7 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.252706 Oct 06 11:17:26.592022 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 550/1091] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:26 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:27.246685 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37afae3c-b353-46ac-9091-d589134582eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:27.247333 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37afae3c-b353-46ac-9091-d589134582eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:27.254304 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37afae3c-b353-46ac-9091-d589134582eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:27.254789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37afae3c-b353-46ac-9091-d589134582eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:27.255234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37afae3c-b353-46ac-9091-d589134582eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:27.255960 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37afae3c-b353-46ac-9091-d589134582eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:27.256425 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37afae3c-b353-46ac-9091-d589134582eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:27.256854 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37afae3c-b353-46ac-9091-d589134582eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:27.382641 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-37afae3c-b353-46ac-9091-d589134582eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:27.390375 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37afae3c-b353-46ac-9091-d589134582eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1366 microversion: 2.1 time: 0.147613 Oct 06 11:17:27.390952 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 542/1092] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:27 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:27.615985 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb0afd03-2fac-4e69-baf9-d2b18f035ed1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:27.616610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb0afd03-2fac-4e69-baf9-d2b18f035ed1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:27.623039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb0afd03-2fac-4e69-baf9-d2b18f035ed1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:27.623528 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb0afd03-2fac-4e69-baf9-d2b18f035ed1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:27.624002 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb0afd03-2fac-4e69-baf9-d2b18f035ed1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:27.624701 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb0afd03-2fac-4e69-baf9-d2b18f035ed1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:27.625158 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb0afd03-2fac-4e69-baf9-d2b18f035ed1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:27.625585 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb0afd03-2fac-4e69-baf9-d2b18f035ed1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:27.759350 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb0afd03-2fac-4e69-baf9-d2b18f035ed1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:27.767151 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb0afd03-2fac-4e69-baf9-d2b18f035ed1 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.155281 Oct 06 11:17:27.767716 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 551/1093] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:27 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:28.413128 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d849dd28-a42a-4c43-a97c-75cb4f9cff8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:28.413766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d849dd28-a42a-4c43-a97c-75cb4f9cff8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:28.420284 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d849dd28-a42a-4c43-a97c-75cb4f9cff8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:28.420766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d849dd28-a42a-4c43-a97c-75cb4f9cff8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:28.421197 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d849dd28-a42a-4c43-a97c-75cb4f9cff8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:28.421880 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d849dd28-a42a-4c43-a97c-75cb4f9cff8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:28.422328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d849dd28-a42a-4c43-a97c-75cb4f9cff8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:28.422743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d849dd28-a42a-4c43-a97c-75cb4f9cff8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:28.554722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d849dd28-a42a-4c43-a97c-75cb4f9cff8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:28.562415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d849dd28-a42a-4c43-a97c-75cb4f9cff8b tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1366 microversion: 2.1 time: 0.153118 Oct 06 11:17:28.562989 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 543/1094] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:28 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:28.790862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22293019-a2aa-42ce-9923-c17dadcf7be2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:28.791423 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-22293019-a2aa-42ce-9923-c17dadcf7be2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:28.798145 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22293019-a2aa-42ce-9923-c17dadcf7be2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:28.798642 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22293019-a2aa-42ce-9923-c17dadcf7be2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:28.799136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22293019-a2aa-42ce-9923-c17dadcf7be2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:28.799998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22293019-a2aa-42ce-9923-c17dadcf7be2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:28.800469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22293019-a2aa-42ce-9923-c17dadcf7be2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:28.800905 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22293019-a2aa-42ce-9923-c17dadcf7be2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:28.952005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-22293019-a2aa-42ce-9923-c17dadcf7be2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:28.961523 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-22293019-a2aa-42ce-9923-c17dadcf7be2 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.174532 Oct 06 11:17:28.962220 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 552/1095] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:28 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:29.587016 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c3b53fa3-e90e-471d-ab3e-71c042013441 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:29.587633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c3b53fa3-e90e-471d-ab3e-71c042013441 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:29.594097 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b53fa3-e90e-471d-ab3e-71c042013441 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:29.594582 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b53fa3-e90e-471d-ab3e-71c042013441 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:29.595021 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b53fa3-e90e-471d-ab3e-71c042013441 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:29.595728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b53fa3-e90e-471d-ab3e-71c042013441 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:29.596770 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b53fa3-e90e-471d-ab3e-71c042013441 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:29.597208 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b53fa3-e90e-471d-ab3e-71c042013441 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:29.727930 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c3b53fa3-e90e-471d-ab3e-71c042013441 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:29.735529 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c3b53fa3-e90e-471d-ab3e-71c042013441 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1366 microversion: 2.1 time: 0.152485 Oct 06 11:17:29.736121 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 544/1096] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:29 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:29.985670 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-751f5209-973e-4f5e-87db-070a125461d0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:29.986304 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-751f5209-973e-4f5e-87db-070a125461d0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:29.993210 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-751f5209-973e-4f5e-87db-070a125461d0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:29.993696 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-751f5209-973e-4f5e-87db-070a125461d0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:29.994129 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-751f5209-973e-4f5e-87db-070a125461d0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:29.994819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-751f5209-973e-4f5e-87db-070a125461d0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:29.995278 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-751f5209-973e-4f5e-87db-070a125461d0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:29.995690 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-751f5209-973e-4f5e-87db-070a125461d0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:30.128426 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-751f5209-973e-4f5e-87db-070a125461d0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:30.136276 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-751f5209-973e-4f5e-87db-070a125461d0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1510 microversion: 2.1 time: 0.154347 Oct 06 11:17:30.136858 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 553/1097] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:29 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:17:30.162940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dd7553d3-94c7-423a-965b-4162edd01b59 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:17:30.164554 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dd7553d3-94c7-423a-965b-4162edd01b59 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:30.170637 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd7553d3-94c7-423a-965b-4162edd01b59 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:30.171123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd7553d3-94c7-423a-965b-4162edd01b59 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:30.171561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd7553d3-94c7-423a-965b-4162edd01b59 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:30.172292 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd7553d3-94c7-423a-965b-4162edd01b59 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:30.172750 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd7553d3-94c7-423a-965b-4162edd01b59 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:30.173176 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd7553d3-94c7-423a-965b-4162edd01b59 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:30.220986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dd7553d3-94c7-423a-965b-4162edd01b59 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120602) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 11:17:30.247375 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:30.297461 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dd7553d3-94c7-423a-965b-4162edd01b59 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "POST /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8/action" status: 202 len: 0 microversion: 2.1 time: 0.139406 Oct 06 11:17:30.298064 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 545/1098] 10.222.0.52 () {60 vars in 1278 bytes} [Thu Oct 6 11:17:30 2022] POST /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:17:30.306148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3f347bb1-1d16-4400-ba16-f0bff5475cca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:30.307137 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3f347bb1-1d16-4400-ba16-f0bff5475cca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:30.309842 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:30.310969 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:30.319677 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f347bb1-1d16-4400-ba16-f0bff5475cca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:30.320221 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f347bb1-1d16-4400-ba16-f0bff5475cca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:30.320663 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f347bb1-1d16-4400-ba16-f0bff5475cca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:30.321378 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f347bb1-1d16-4400-ba16-f0bff5475cca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:30.321832 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f347bb1-1d16-4400-ba16-f0bff5475cca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:30.322258 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f347bb1-1d16-4400-ba16-f0bff5475cca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:30.513189 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3f347bb1-1d16-4400-ba16-f0bff5475cca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:30.521811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3f347bb1-1d16-4400-ba16-f0bff5475cca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1518 microversion: 2.1 time: 0.219717 Oct 06 11:17:30.522741 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 554/1099] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:30 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1518 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:30.760965 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e683d04-2ee2-4766-83fe-614db0d30362 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:30.761869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e683d04-2ee2-4766-83fe-614db0d30362 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:30.768094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e683d04-2ee2-4766-83fe-614db0d30362 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:30.768594 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e683d04-2ee2-4766-83fe-614db0d30362 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:30.769910 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e683d04-2ee2-4766-83fe-614db0d30362 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:30.770775 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e683d04-2ee2-4766-83fe-614db0d30362 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:30.771244 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e683d04-2ee2-4766-83fe-614db0d30362 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:30.771673 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e683d04-2ee2-4766-83fe-614db0d30362 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:30.925610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-521fd794-5094-4d9a-823a-4721af956c28 req-be6d4e08-5947-42c4-97f7-fed74fbf562b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65604ed1-1c1e-4050-b0f1-821dcd37a862", "name": "network-vif-plugged", "status": "completed", "tag": "704b0c2d-ea1f-4607-8dfa-0f321f1b5467"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:17:30.934243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e683d04-2ee2-4766-83fe-614db0d30362 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:30.937256 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-521fd794-5094-4d9a-823a-4721af956c28 req-be6d4e08-5947-42c4-97f7-fed74fbf562b service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:30.937739 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-521fd794-5094-4d9a-823a-4721af956c28 req-be6d4e08-5947-42c4-97f7-fed74fbf562b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:30.938854 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-521fd794-5094-4d9a-823a-4721af956c28 req-be6d4e08-5947-42c4-97f7-fed74fbf562b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:30.944368 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e683d04-2ee2-4766-83fe-614db0d30362 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1366 microversion: 2.1 time: 0.188452 Oct 06 11:17:30.944961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 546/1100] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:30 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:30.951117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-521fd794-5094-4d9a-823a-4721af956c28 req-be6d4e08-5947-42c4-97f7-fed74fbf562b service nova] Creating event network-vif-plugged:704b0c2d-ea1f-4607-8dfa-0f321f1b5467 for instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 on hv-cinder-86020 Oct 06 11:17:30.956219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-521fd794-5094-4d9a-823a-4721af956c28 req-be6d4e08-5947-42c4-97f7-fed74fbf562b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034796 Oct 06 11:17:30.957824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 555/1101] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:17:31.546345 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a544e5a-ff3e-4249-abd5-da2f7edfc57f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:31.546959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a544e5a-ff3e-4249-abd5-da2f7edfc57f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:31.553441 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a544e5a-ff3e-4249-abd5-da2f7edfc57f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:31.553922 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a544e5a-ff3e-4249-abd5-da2f7edfc57f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:31.554357 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a544e5a-ff3e-4249-abd5-da2f7edfc57f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:31.555042 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a544e5a-ff3e-4249-abd5-da2f7edfc57f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:31.555492 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a544e5a-ff3e-4249-abd5-da2f7edfc57f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:31.555940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a544e5a-ff3e-4249-abd5-da2f7edfc57f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:31.691247 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a544e5a-ff3e-4249-abd5-da2f7edfc57f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:31.699421 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a544e5a-ff3e-4249-abd5-da2f7edfc57f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1520 microversion: 2.1 time: 0.156922 Oct 06 11:17:31.700013 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 547/1102] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:31 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:31.969557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-975dc5e2-2702-40e6-9840-b6b89c5f816e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:31.970911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-975dc5e2-2702-40e6-9840-b6b89c5f816e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:31.977889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-975dc5e2-2702-40e6-9840-b6b89c5f816e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:31.978420 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-975dc5e2-2702-40e6-9840-b6b89c5f816e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:31.978881 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-975dc5e2-2702-40e6-9840-b6b89c5f816e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:31.979583 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-975dc5e2-2702-40e6-9840-b6b89c5f816e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:31.980086 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-975dc5e2-2702-40e6-9840-b6b89c5f816e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:31.980511 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-975dc5e2-2702-40e6-9840-b6b89c5f816e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:32.113992 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-975dc5e2-2702-40e6-9840-b6b89c5f816e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:32.121780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-975dc5e2-2702-40e6-9840-b6b89c5f816e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1366 microversion: 2.1 time: 0.157041 Oct 06 11:17:32.122348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 556/1103] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:31 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:32.724009 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-961949bc-e7b5-4e96-94e0-608b67fd764d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:32.724551 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-961949bc-e7b5-4e96-94e0-608b67fd764d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:32.730898 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-961949bc-e7b5-4e96-94e0-608b67fd764d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:32.731377 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-961949bc-e7b5-4e96-94e0-608b67fd764d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:32.731810 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-961949bc-e7b5-4e96-94e0-608b67fd764d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:32.732524 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-961949bc-e7b5-4e96-94e0-608b67fd764d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:32.732972 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-961949bc-e7b5-4e96-94e0-608b67fd764d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:32.733393 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-961949bc-e7b5-4e96-94e0-608b67fd764d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:32.866699 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-961949bc-e7b5-4e96-94e0-608b67fd764d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:32.874409 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-961949bc-e7b5-4e96-94e0-608b67fd764d tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.154612 Oct 06 11:17:32.874975 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 548/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:32 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:32.977749 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-bc734189-be85-4f2b-8693-df6cd023331e req-744c0538-4dcf-4c95-9925-ac6ccd076a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6e0b3e-d553-4434-8a4f-b70e545a33f8", "name": "network-vif-unplugged", "status": "completed", "tag": "b4073667-1fd2-4402-b6cb-c6a7057072a4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:17:32.988132 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bc734189-be85-4f2b-8693-df6cd023331e req-744c0538-4dcf-4c95-9925-ac6ccd076a43 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:32.988622 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bc734189-be85-4f2b-8693-df6cd023331e req-744c0538-4dcf-4c95-9925-ac6ccd076a43 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:32.989057 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bc734189-be85-4f2b-8693-df6cd023331e req-744c0538-4dcf-4c95-9925-ac6ccd076a43 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:32.999758 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-bc734189-be85-4f2b-8693-df6cd023331e req-744c0538-4dcf-4c95-9925-ac6ccd076a43 service nova] Creating event network-vif-unplugged:b4073667-1fd2-4402-b6cb-c6a7057072a4 for instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 on hv-cinder-86020 Oct 06 11:17:33.004576 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-bc734189-be85-4f2b-8693-df6cd023331e req-744c0538-4dcf-4c95-9925-ac6ccd076a43 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030471 Oct 06 11:17:33.005147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 557/1105] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:17:33.148953 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2752c420-9f81-4040-b949-8a8acce3e104 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:33.149566 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2752c420-9f81-4040-b949-8a8acce3e104 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:33.155450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2752c420-9f81-4040-b949-8a8acce3e104 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:33.155965 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2752c420-9f81-4040-b949-8a8acce3e104 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:33.156401 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2752c420-9f81-4040-b949-8a8acce3e104 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:33.157089 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2752c420-9f81-4040-b949-8a8acce3e104 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:33.157536 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2752c420-9f81-4040-b949-8a8acce3e104 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:33.157955 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2752c420-9f81-4040-b949-8a8acce3e104 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:33.285344 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2752c420-9f81-4040-b949-8a8acce3e104 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:33.293733 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2752c420-9f81-4040-b949-8a8acce3e104 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1555 microversion: 2.1 time: 0.148823 Oct 06 11:17:33.294302 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 549/1106] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:33 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:33.316071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0231cb51-fbd0-4937-b4a8-b6e857be8fe6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:33.316719 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0231cb51-fbd0-4937-b4a8-b6e857be8fe6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:33.322697 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0231cb51-fbd0-4937-b4a8-b6e857be8fe6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:33.323180 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0231cb51-fbd0-4937-b4a8-b6e857be8fe6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:33.323615 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0231cb51-fbd0-4937-b4a8-b6e857be8fe6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:33.324334 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0231cb51-fbd0-4937-b4a8-b6e857be8fe6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:33.324784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0231cb51-fbd0-4937-b4a8-b6e857be8fe6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:33.325204 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0231cb51-fbd0-4937-b4a8-b6e857be8fe6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:33.405950 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0231cb51-fbd0-4937-b4a8-b6e857be8fe6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093930 Oct 06 11:17:33.406824 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 558/1107] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Oct 6 11:17:33 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:17:33.899283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7cda6738-53ed-4f39-a38d-c3569f86350f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:33.899962 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7cda6738-53ed-4f39-a38d-c3569f86350f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:33.906814 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cda6738-53ed-4f39-a38d-c3569f86350f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:33.907314 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cda6738-53ed-4f39-a38d-c3569f86350f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:33.907757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cda6738-53ed-4f39-a38d-c3569f86350f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:33.908783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cda6738-53ed-4f39-a38d-c3569f86350f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:33.909425 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cda6738-53ed-4f39-a38d-c3569f86350f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:33.909857 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cda6738-53ed-4f39-a38d-c3569f86350f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:34.298974 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-7cda6738-53ed-4f39-a38d-c3569f86350f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:34.307671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7cda6738-53ed-4f39-a38d-c3569f86350f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.413506 Oct 06 11:17:34.308343 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 550/1108] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:33 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:34.709153 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0a7a6a7f-54c4-4786-af82-a0f58ec42704 req-4a7760ce-6ea3-45e1-8c4b-70f4f4d275c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65604ed1-1c1e-4050-b0f1-821dcd37a862", "tag": "704b0c2d-ea1f-4607-8dfa-0f321f1b5467"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:17:34.718501 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0a7a6a7f-54c4-4786-af82-a0f58ec42704 req-4a7760ce-6ea3-45e1-8c4b-70f4f4d275c0 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:34.718977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0a7a6a7f-54c4-4786-af82-a0f58ec42704 req-4a7760ce-6ea3-45e1-8c4b-70f4f4d275c0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:34.719410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0a7a6a7f-54c4-4786-af82-a0f58ec42704 req-4a7760ce-6ea3-45e1-8c4b-70f4f4d275c0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:34.724146 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:34.731872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0a7a6a7f-54c4-4786-af82-a0f58ec42704 req-4a7760ce-6ea3-45e1-8c4b-70f4f4d275c0 service nova] Creating event network-changed:704b0c2d-ea1f-4607-8dfa-0f321f1b5467 for instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 on hv-cinder-86020 Oct 06 11:17:34.736863 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0a7a6a7f-54c4-4786-af82-a0f58ec42704 req-4a7760ce-6ea3-45e1-8c4b-70f4f4d275c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086878 Oct 06 11:17:34.737689 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 559/1109] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:17:35.330468 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2c161855-7e0f-4276-a90a-394698d55149 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:35.332540 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2c161855-7e0f-4276-a90a-394698d55149 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:35.343550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c161855-7e0f-4276-a90a-394698d55149 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:35.344160 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c161855-7e0f-4276-a90a-394698d55149 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:35.344838 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c161855-7e0f-4276-a90a-394698d55149 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:35.345797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c161855-7e0f-4276-a90a-394698d55149 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:35.346476 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c161855-7e0f-4276-a90a-394698d55149 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:35.347205 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c161855-7e0f-4276-a90a-394698d55149 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:35.491231 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2c161855-7e0f-4276-a90a-394698d55149 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:35.499273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2c161855-7e0f-4276-a90a-394698d55149 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.172601 Oct 06 11:17:35.499881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 551/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:35 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:36.524897 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6886ed3f-fd06-4d1f-9306-b15ef6da5151 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:36.525595 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6886ed3f-fd06-4d1f-9306-b15ef6da5151 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:36.532735 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6886ed3f-fd06-4d1f-9306-b15ef6da5151 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:36.533219 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6886ed3f-fd06-4d1f-9306-b15ef6da5151 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:36.533652 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6886ed3f-fd06-4d1f-9306-b15ef6da5151 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:36.534972 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6886ed3f-fd06-4d1f-9306-b15ef6da5151 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:36.535437 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6886ed3f-fd06-4d1f-9306-b15ef6da5151 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:36.535872 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6886ed3f-fd06-4d1f-9306-b15ef6da5151 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:36.667901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6886ed3f-fd06-4d1f-9306-b15ef6da5151 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:36.675581 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6886ed3f-fd06-4d1f-9306-b15ef6da5151 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.155732 Oct 06 11:17:36.676176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 560/1111] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:36 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:37.698962 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2138e662-d4ae-4620-a9f1-5e64e6109485 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:37.699511 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2138e662-d4ae-4620-a9f1-5e64e6109485 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:37.705965 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2138e662-d4ae-4620-a9f1-5e64e6109485 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:37.707094 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2138e662-d4ae-4620-a9f1-5e64e6109485 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:37.707534 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2138e662-d4ae-4620-a9f1-5e64e6109485 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:37.708262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2138e662-d4ae-4620-a9f1-5e64e6109485 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:37.708722 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2138e662-d4ae-4620-a9f1-5e64e6109485 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:37.709149 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2138e662-d4ae-4620-a9f1-5e64e6109485 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:37.838853 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2138e662-d4ae-4620-a9f1-5e64e6109485 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:37.846601 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2138e662-d4ae-4620-a9f1-5e64e6109485 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.151556 Oct 06 11:17:37.847585 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 552/1112] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:37 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:38.869883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e7b48e8-7345-4f95-ad56-8eb94be182b9 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:38.870498 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e7b48e8-7345-4f95-ad56-8eb94be182b9 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:38.876987 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7b48e8-7345-4f95-ad56-8eb94be182b9 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:38.877467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7b48e8-7345-4f95-ad56-8eb94be182b9 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:38.878404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7b48e8-7345-4f95-ad56-8eb94be182b9 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:38.879115 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7b48e8-7345-4f95-ad56-8eb94be182b9 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:38.879573 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7b48e8-7345-4f95-ad56-8eb94be182b9 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:38.880036 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7b48e8-7345-4f95-ad56-8eb94be182b9 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:39.018098 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e7b48e8-7345-4f95-ad56-8eb94be182b9 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:39.026668 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e7b48e8-7345-4f95-ad56-8eb94be182b9 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.160640 Oct 06 11:17:39.027200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 561/1113] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:38 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:40.049445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-56e41ad0-b33c-4d18-a755-f14737157067 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:40.050096 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-56e41ad0-b33c-4d18-a755-f14737157067 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:40.052538 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:40.057790 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56e41ad0-b33c-4d18-a755-f14737157067 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:40.058280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56e41ad0-b33c-4d18-a755-f14737157067 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:40.058720 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56e41ad0-b33c-4d18-a755-f14737157067 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:40.059419 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56e41ad0-b33c-4d18-a755-f14737157067 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:40.059907 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56e41ad0-b33c-4d18-a755-f14737157067 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:40.060341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56e41ad0-b33c-4d18-a755-f14737157067 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:40.193311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-56e41ad0-b33c-4d18-a755-f14737157067 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:40.201120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-56e41ad0-b33c-4d18-a755-f14737157067 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.155467 Oct 06 11:17:40.201631 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 553/1114] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:40 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:41.225271 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-02cd1812-2b96-4808-9403-fcf692509813 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:41.225897 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-02cd1812-2b96-4808-9403-fcf692509813 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:41.228466 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:41.233837 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02cd1812-2b96-4808-9403-fcf692509813 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:41.234331 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02cd1812-2b96-4808-9403-fcf692509813 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:41.234771 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02cd1812-2b96-4808-9403-fcf692509813 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:41.235474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02cd1812-2b96-4808-9403-fcf692509813 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:41.235964 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02cd1812-2b96-4808-9403-fcf692509813 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:41.236393 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02cd1812-2b96-4808-9403-fcf692509813 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:41.368524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-02cd1812-2b96-4808-9403-fcf692509813 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:41.376304 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-02cd1812-2b96-4808-9403-fcf692509813 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.155585 Oct 06 11:17:41.376868 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 562/1115] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:41 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:42.399527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf1235e5-98aa-4a41-9f92-a167f8aab11f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:42.400174 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf1235e5-98aa-4a41-9f92-a167f8aab11f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:42.406800 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf1235e5-98aa-4a41-9f92-a167f8aab11f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:42.407280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf1235e5-98aa-4a41-9f92-a167f8aab11f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:42.407716 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf1235e5-98aa-4a41-9f92-a167f8aab11f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:42.408433 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf1235e5-98aa-4a41-9f92-a167f8aab11f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:42.408884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf1235e5-98aa-4a41-9f92-a167f8aab11f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:42.409759 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf1235e5-98aa-4a41-9f92-a167f8aab11f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:42.541723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf1235e5-98aa-4a41-9f92-a167f8aab11f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:42.549588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf1235e5-98aa-4a41-9f92-a167f8aab11f tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.154176 Oct 06 11:17:42.550856 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 554/1116] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:42 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:43.574690 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98790d6f-61af-4bc9-b621-05d23222bfc5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:43.575462 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-98790d6f-61af-4bc9-b621-05d23222bfc5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:43.582578 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98790d6f-61af-4bc9-b621-05d23222bfc5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:43.583059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98790d6f-61af-4bc9-b621-05d23222bfc5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:43.583492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98790d6f-61af-4bc9-b621-05d23222bfc5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:43.584225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98790d6f-61af-4bc9-b621-05d23222bfc5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:43.584676 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98790d6f-61af-4bc9-b621-05d23222bfc5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:43.585099 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98790d6f-61af-4bc9-b621-05d23222bfc5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:43.715871 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-98790d6f-61af-4bc9-b621-05d23222bfc5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:43.723750 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-98790d6f-61af-4bc9-b621-05d23222bfc5 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.153017 Oct 06 11:17:43.724345 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 563/1117] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:43 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:44.746929 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b4cecf39-6c04-4ee1-ad8a-58e870a663ca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:44.747543 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b4cecf39-6c04-4ee1-ad8a-58e870a663ca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:44.754487 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cecf39-6c04-4ee1-ad8a-58e870a663ca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:44.754968 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cecf39-6c04-4ee1-ad8a-58e870a663ca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:44.755403 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cecf39-6c04-4ee1-ad8a-58e870a663ca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:44.756155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cecf39-6c04-4ee1-ad8a-58e870a663ca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:44.756606 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cecf39-6c04-4ee1-ad8a-58e870a663ca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:44.757029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cecf39-6c04-4ee1-ad8a-58e870a663ca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:44.889415 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b4cecf39-6c04-4ee1-ad8a-58e870a663ca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:44.898736 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b4cecf39-6c04-4ee1-ad8a-58e870a663ca tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.155612 Oct 06 11:17:44.899315 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 555/1118] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:44 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:44.985809 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d10444cb-a7fd-499c-b267-479fb8011091 req-c49eaa0b-a47b-40aa-951d-5de898483dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6e0b3e-d553-4434-8a4f-b70e545a33f8", "name": "network-vif-plugged", "status": "completed", "tag": "b4073667-1fd2-4402-b6cb-c6a7057072a4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:17:44.995776 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d10444cb-a7fd-499c-b267-479fb8011091 req-c49eaa0b-a47b-40aa-951d-5de898483dd0 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:44.996383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d10444cb-a7fd-499c-b267-479fb8011091 req-c49eaa0b-a47b-40aa-951d-5de898483dd0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:44.996895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d10444cb-a7fd-499c-b267-479fb8011091 req-c49eaa0b-a47b-40aa-951d-5de898483dd0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:45.011198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d10444cb-a7fd-499c-b267-479fb8011091 req-c49eaa0b-a47b-40aa-951d-5de898483dd0 service nova] Creating event network-vif-plugged:b4073667-1fd2-4402-b6cb-c6a7057072a4 for instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 on hv-cinder-86020 Oct 06 11:17:45.016427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d10444cb-a7fd-499c-b267-479fb8011091 req-c49eaa0b-a47b-40aa-951d-5de898483dd0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034416 Oct 06 11:17:45.017202 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 564/1119] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:17:45.922136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4275cc54-8b7c-4ff7-8cdd-1cac862cf863 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:45.922755 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4275cc54-8b7c-4ff7-8cdd-1cac862cf863 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:45.929976 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4275cc54-8b7c-4ff7-8cdd-1cac862cf863 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:45.930465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4275cc54-8b7c-4ff7-8cdd-1cac862cf863 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:45.930904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4275cc54-8b7c-4ff7-8cdd-1cac862cf863 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:45.931597 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4275cc54-8b7c-4ff7-8cdd-1cac862cf863 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:45.932090 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4275cc54-8b7c-4ff7-8cdd-1cac862cf863 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:45.932529 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4275cc54-8b7c-4ff7-8cdd-1cac862cf863 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:46.065390 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4275cc54-8b7c-4ff7-8cdd-1cac862cf863 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:46.073321 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4275cc54-8b7c-4ff7-8cdd-1cac862cf863 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1576 microversion: 2.1 time: 0.155100 Oct 06 11:17:46.073894 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 556/1120] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:45 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:17:47.098470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5f2c402-d7cd-4881-bc1d-3cff34dee564 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:17:47.099373 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5f2c402-d7cd-4881-bc1d-3cff34dee564 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:17:47.105594 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5f2c402-d7cd-4881-bc1d-3cff34dee564 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:47.106084 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5f2c402-d7cd-4881-bc1d-3cff34dee564 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:47.106522 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5f2c402-d7cd-4881-bc1d-3cff34dee564 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:47.107227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5f2c402-d7cd-4881-bc1d-3cff34dee564 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:17:47.107682 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5f2c402-d7cd-4881-bc1d-3cff34dee564 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:17:47.108135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5f2c402-d7cd-4881-bc1d-3cff34dee564 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:17:47.242132 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5f2c402-d7cd-4881-bc1d-3cff34dee564 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:17:47.250175 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5f2c402-d7cd-4881-bc1d-3cff34dee564 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1563 microversion: 2.1 time: 0.157315 Oct 06 11:17:47.250746 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 565/1121] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:17:47 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:18:49.828774 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=7 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:18:49.829551 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:18:49.830519 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 11:18:49.830666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Thu Oct 6 11:18:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862/ips (ip 10.222.0.52) !!! Oct 06 11:18:49.836343 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d38b6767-82f2-4f30-a90a-a27094ae689a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:49.836839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d38b6767-82f2-4f30-a90a-a27094ae689a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:49.844898 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d38b6767-82f2-4f30-a90a-a27094ae689a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:49.845367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d38b6767-82f2-4f30-a90a-a27094ae689a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:49.845802 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d38b6767-82f2-4f30-a90a-a27094ae689a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:49.846492 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d38b6767-82f2-4f30-a90a-a27094ae689a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:49.846944 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d38b6767-82f2-4f30-a90a-a27094ae689a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:49.847397 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d38b6767-82f2-4f30-a90a-a27094ae689a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:49.871858 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d38b6767-82f2-4f30-a90a-a27094ae689a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862/ips" status: 200 len: 148 microversion: 2.1 time: 0.044939 Oct 06 11:18:49.872448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 557/1122] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Oct 6 11:18:49 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:18:49.882142 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:18:49.882889 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=32 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:18:49.887455 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b60860d-fb68-4764-93ee-fd81d60e8fc2"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:18:49.889841 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:49.897866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:49.898351 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:49.898792 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:49.899494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:49.900000 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:49.900435 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:49.979788 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Invalid volume: volume 9b60860d-fb68-4764-93ee-fd81d60e8fc2 is already attached to instances: e437667e-27e0-4c28-8bbd-206763b7d3bb Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862/os-volume_attachments HTTP/1.1 Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 74 Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:18:49.981621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {"volumeAttachment": {"volumeId": "9b60860d-fb68-4764-93ee-fd81d60e8fc2"}} Oct 06 11:18:49.983123 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Invalid volume: volume 9b60860d-fb68-4764-93ee-fd81d60e8fc2 is already attached to instances: e437667e-27e0-4c28-8bbd-206763b7d3bb Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'server_id': '65604ed1-1c1e-4050-b0f1-821dcd37a862', 'body': {'volumeAttachment': {'volumeId': '9b60860d-fb68-4764-93ee-fd81d60e8fc2'}}} Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9b60860d-fb68-4764-93ee-fd81d60e8fc2 is already attached to instances: e437667e-27e0-4c28-8bbd-206763b7d3bb Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:18:49.984290 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9b60860d-fb68-4764-93ee-fd81d60e8fc2 is already attached to instances: e437667e-27e0-4c28-8bbd-206763b7d3bb Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:18:49.985874 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:18:49.987399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:18:49.987399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:18:49.987399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:18:49.987399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9b60860d-fb68-4764-93ee-fd81d60e8fc2 is already attached to instances: e437667e-27e0-4c28-8bbd-206763b7d3bb Oct 06 11:18:49.987399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:18:49.987399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 400 to user: Invalid volume: volume 9b60860d-fb68-4764-93ee-fd81d60e8fc2 is already attached to instances: e437667e-27e0-4c28-8bbd-206763b7d3bb {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:18:49.987399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c32a02ef-5917-45f1-8c31-28888ba40de5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103201 Oct 06 11:18:49.987399 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 566/1123] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:18:49 2022] POST /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 11:18:49.992155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-04500641-bec6-4174-8907-55e9e18aed30 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:49.992664 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-04500641-bec6-4174-8907-55e9e18aed30 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:49.998538 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04500641-bec6-4174-8907-55e9e18aed30 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:49.999029 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04500641-bec6-4174-8907-55e9e18aed30 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:49.999473 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04500641-bec6-4174-8907-55e9e18aed30 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:50.000195 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04500641-bec6-4174-8907-55e9e18aed30 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:50.000657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04500641-bec6-4174-8907-55e9e18aed30 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:50.001085 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04500641-bec6-4174-8907-55e9e18aed30 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:50.026706 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-04500641-bec6-4174-8907-55e9e18aed30 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:18:50.100717 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-04500641-bec6-4174-8907-55e9e18aed30 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 204 len: 0 microversion: 2.1 time: 0.112086 Oct 06 11:18:50.101252 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 558/1124] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:18:49 2022] DELETE /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:18:50.109288 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1cd926d3-e12a-4062-b857-090714a40b6f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:50.109891 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1cd926d3-e12a-4062-b857-090714a40b6f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:50.116944 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd926d3-e12a-4062-b857-090714a40b6f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:50.117431 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd926d3-e12a-4062-b857-090714a40b6f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:50.117869 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd926d3-e12a-4062-b857-090714a40b6f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:50.118564 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd926d3-e12a-4062-b857-090714a40b6f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:50.119020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd926d3-e12a-4062-b857-090714a40b6f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:50.119448 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd926d3-e12a-4062-b857-090714a40b6f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:50.251628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1cd926d3-e12a-4062-b857-090714a40b6f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:18:50.260310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1cd926d3-e12a-4062-b857-090714a40b6f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1679 microversion: 2.1 time: 0.154827 Oct 06 11:18:50.260878 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 567/1125] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:18:50 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:18:51.286080 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66990d5d-6773-4d3a-abe7-5f58a4b1fd32 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:51.287715 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66990d5d-6773-4d3a-abe7-5f58a4b1fd32 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:51.294104 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66990d5d-6773-4d3a-abe7-5f58a4b1fd32 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:51.294573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66990d5d-6773-4d3a-abe7-5f58a4b1fd32 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:51.295011 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66990d5d-6773-4d3a-abe7-5f58a4b1fd32 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:51.295699 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66990d5d-6773-4d3a-abe7-5f58a4b1fd32 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:51.296169 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66990d5d-6773-4d3a-abe7-5f58a4b1fd32 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:51.296587 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66990d5d-6773-4d3a-abe7-5f58a4b1fd32 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:51.428182 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-66990d5d-6773-4d3a-abe7-5f58a4b1fd32 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:18:51.435769 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66990d5d-6773-4d3a-abe7-5f58a4b1fd32 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1679 microversion: 2.1 time: 0.153906 Oct 06 11:18:51.436388 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 559/1126] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:18:51 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:18:52.458602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80b6bba4-e653-4301-a858-25e38b5a1f1c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:52.459221 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-80b6bba4-e653-4301-a858-25e38b5a1f1c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:52.466072 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80b6bba4-e653-4301-a858-25e38b5a1f1c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:52.466554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80b6bba4-e653-4301-a858-25e38b5a1f1c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:52.466996 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80b6bba4-e653-4301-a858-25e38b5a1f1c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:52.467698 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80b6bba4-e653-4301-a858-25e38b5a1f1c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:52.468364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80b6bba4-e653-4301-a858-25e38b5a1f1c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:52.468602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80b6bba4-e653-4301-a858-25e38b5a1f1c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:52.702942 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-80b6bba4-e653-4301-a858-25e38b5a1f1c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:18:52.711225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-80b6bba4-e653-4301-a858-25e38b5a1f1c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 200 len: 1679 microversion: 2.1 time: 0.256492 Oct 06 11:18:52.711796 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 568/1127] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:18:52 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 1679 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:18:52.929892 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-799dae60-ff0d-45ce-a83a-a2bc3e5eeb36 req-fd831a5b-be51-4d54-945d-c12f393c6c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65604ed1-1c1e-4050-b0f1-821dcd37a862", "name": "network-vif-deleted", "tag": "704b0c2d-ea1f-4607-8dfa-0f321f1b5467"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:18:52.939209 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-799dae60-ff0d-45ce-a83a-a2bc3e5eeb36 req-fd831a5b-be51-4d54-945d-c12f393c6c9b service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:52.939693 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-799dae60-ff0d-45ce-a83a-a2bc3e5eeb36 req-fd831a5b-be51-4d54-945d-c12f393c6c9b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:52.940161 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-799dae60-ff0d-45ce-a83a-a2bc3e5eeb36 req-fd831a5b-be51-4d54-945d-c12f393c6c9b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:52.952054 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-799dae60-ff0d-45ce-a83a-a2bc3e5eeb36 req-fd831a5b-be51-4d54-945d-c12f393c6c9b service nova] Creating event network-vif-deleted:704b0c2d-ea1f-4607-8dfa-0f321f1b5467 for instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 on hv-cinder-86020 Oct 06 11:18:52.957553 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-799dae60-ff0d-45ce-a83a-a2bc3e5eeb36 req-fd831a5b-be51-4d54-945d-c12f393c6c9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032091 Oct 06 11:18:52.959294 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 560/1128] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:18:53.734575 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:53.735778 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:53.742522 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:53.743011 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:53.743452 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:53.745822 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:53.745822 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:53.746111 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:53.760732 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 HTTP/1.1 Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:18:53.762299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:18:53.764093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '65604ed1-1c1e-4050-b0f1-821dcd37a862'} Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:18:53.765139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:18:53.767006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:18:53.769348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:18:53.769348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-22156784-ea6b-4759-b2f3-58b723651381 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 404 len: 111 microversion: 2.1 time: 0.033025 Oct 06 11:18:53.769348 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 569/1129] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:18:53 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:18:53.774003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5c15ffd-1a34-4228-9043-849a684bf216 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '.version_select at 0x7f92a6f75e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:53.796272 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5c15ffd-1a34-4228-9043-849a684bf216 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-35174386" status: 202 len: 0 microversion: 2.1 time: 0.027241 Oct 06 11:18:53.796855 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 561/1130] 10.222.0.52 () {58 vars in 1215 bytes} [Thu Oct 6 11:18:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-35174386 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:18:54.470884 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6451a04-ff5e-468d-840f-fad5ec116dcc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:54.471421 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6451a04-ff5e-468d-840f-fad5ec116dcc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:54.477648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6451a04-ff5e-468d-840f-fad5ec116dcc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:54.478140 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6451a04-ff5e-468d-840f-fad5ec116dcc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:54.478592 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6451a04-ff5e-468d-840f-fad5ec116dcc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:54.479296 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6451a04-ff5e-468d-840f-fad5ec116dcc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:54.479758 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6451a04-ff5e-468d-840f-fad5ec116dcc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:54.480215 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6451a04-ff5e-468d-840f-fad5ec116dcc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:54.560353 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-e6451a04-ff5e-468d-840f-fad5ec116dcc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lazy-loading 'services' on Instance uuid e437667e-27e0-4c28-8bbd-206763b7d3bb {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:18:54.630410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6451a04-ff5e-468d-840f-fad5ec116dcc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/os-volume_attachments/9b60860d-fb68-4764-93ee-fd81d60e8fc2" status: 202 len: 0 microversion: 2.1 time: 0.163144 Oct 06 11:18:54.631101 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 570/1131] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:18:54 2022] DELETE /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/os-volume_attachments/9b60860d-fb68-4764-93ee-fd81d60e8fc2 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:18:54.640129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d1b9c405-56f2-4918-9b86-d5861f861842 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:54.642436 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d1b9c405-56f2-4918-9b86-d5861f861842 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:54.649583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b9c405-56f2-4918-9b86-d5861f861842 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:54.650072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b9c405-56f2-4918-9b86-d5861f861842 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:54.650507 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b9c405-56f2-4918-9b86-d5861f861842 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:54.651263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b9c405-56f2-4918-9b86-d5861f861842 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:54.651743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b9c405-56f2-4918-9b86-d5861f861842 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:54.652217 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b9c405-56f2-4918-9b86-d5861f861842 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:54.683352 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d1b9c405-56f2-4918-9b86-d5861f861842 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047874 Oct 06 11:18:54.684146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 562/1132] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:18:54 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:18:55.697523 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a25c1471-808b-43a7-a95a-f9115ff41d9f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:55.699948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a25c1471-808b-43a7-a95a-f9115ff41d9f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:55.706130 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25c1471-808b-43a7-a95a-f9115ff41d9f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:55.706687 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25c1471-808b-43a7-a95a-f9115ff41d9f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:55.707166 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25c1471-808b-43a7-a95a-f9115ff41d9f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:55.708074 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25c1471-808b-43a7-a95a-f9115ff41d9f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:55.708556 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25c1471-808b-43a7-a95a-f9115ff41d9f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:55.709006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25c1471-808b-43a7-a95a-f9115ff41d9f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:55.740735 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a25c1471-808b-43a7-a95a-f9115ff41d9f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048668 Oct 06 11:18:55.741284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 571/1133] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:18:55 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 11:18:55.808920 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-446c4044-7007-4b8d-ae05-1876c4928e9c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:55.809527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-446c4044-7007-4b8d-ae05-1876c4928e9c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:55.815676 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-446c4044-7007-4b8d-ae05-1876c4928e9c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:55.816186 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-446c4044-7007-4b8d-ae05-1876c4928e9c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:55.816620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-446c4044-7007-4b8d-ae05-1876c4928e9c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:55.817309 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-446c4044-7007-4b8d-ae05-1876c4928e9c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:55.818464 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-446c4044-7007-4b8d-ae05-1876c4928e9c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:55.818877 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-446c4044-7007-4b8d-ae05-1876c4928e9c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:55.845075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-446c4044-7007-4b8d-ae05-1876c4928e9c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:18:55.917696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-446c4044-7007-4b8d-ae05-1876c4928e9c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 204 len: 0 microversion: 2.1 time: 0.112266 Oct 06 11:18:55.918199 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 563/1134] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:18:55 2022] DELETE /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 11:18:55.927960 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd5adb98-782a-444c-94da-80e509534b49 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:55.928583 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bd5adb98-782a-444c-94da-80e509534b49 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:55.934486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd5adb98-782a-444c-94da-80e509534b49 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:55.935059 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd5adb98-782a-444c-94da-80e509534b49 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:55.935492 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd5adb98-782a-444c-94da-80e509534b49 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:55.936214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd5adb98-782a-444c-94da-80e509534b49 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:55.936665 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd5adb98-782a-444c-94da-80e509534b49 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:55.937089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd5adb98-782a-444c-94da-80e509534b49 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:56.066540 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bd5adb98-782a-444c-94da-80e509534b49 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:18:56.074697 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd5adb98-782a-444c-94da-80e509534b49 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1680 microversion: 2.1 time: 0.152233 Oct 06 11:18:56.075263 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 572/1135] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:18:55 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:18:57.099750 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d0ab62b6-cb7d-49d1-8b86-5e259eaf34f6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:57.100495 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d0ab62b6-cb7d-49d1-8b86-5e259eaf34f6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:57.106966 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ab62b6-cb7d-49d1-8b86-5e259eaf34f6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:57.107458 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ab62b6-cb7d-49d1-8b86-5e259eaf34f6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:57.107961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ab62b6-cb7d-49d1-8b86-5e259eaf34f6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:57.108672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ab62b6-cb7d-49d1-8b86-5e259eaf34f6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:57.109129 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ab62b6-cb7d-49d1-8b86-5e259eaf34f6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:57.109560 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ab62b6-cb7d-49d1-8b86-5e259eaf34f6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:57.240850 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d0ab62b6-cb7d-49d1-8b86-5e259eaf34f6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:18:57.248514 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d0ab62b6-cb7d-49d1-8b86-5e259eaf34f6 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1680 microversion: 2.1 time: 0.153600 Oct 06 11:18:57.249081 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 564/1136] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:18:57 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:18:58.272685 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ab3595f-01a2-4516-b589-36c6194fbcf9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:58.273321 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ab3595f-01a2-4516-b589-36c6194fbcf9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:58.279983 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ab3595f-01a2-4516-b589-36c6194fbcf9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:58.280479 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ab3595f-01a2-4516-b589-36c6194fbcf9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:58.280922 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ab3595f-01a2-4516-b589-36c6194fbcf9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:58.281638 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ab3595f-01a2-4516-b589-36c6194fbcf9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:58.282114 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ab3595f-01a2-4516-b589-36c6194fbcf9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:58.282527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ab3595f-01a2-4516-b589-36c6194fbcf9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:58.509544 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1ab3595f-01a2-4516-b589-36c6194fbcf9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:18:58.517708 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ab3595f-01a2-4516-b589-36c6194fbcf9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1680 microversion: 2.1 time: 0.250097 Oct 06 11:18:58.518298 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 573/1137] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:18:58 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:18:59.059347 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-84d4f24b-4eb0-4099-9e30-6b9816d83156 req-db6aaa5a-f1bf-4096-8c8c-1313eaea7b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e437667e-27e0-4c28-8bbd-206763b7d3bb", "name": "network-vif-deleted", "tag": "d4154cb8-50f5-4bb6-a532-639edec2c403"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:18:59.070141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-84d4f24b-4eb0-4099-9e30-6b9816d83156 req-db6aaa5a-f1bf-4096-8c8c-1313eaea7b9d service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:59.070616 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-84d4f24b-4eb0-4099-9e30-6b9816d83156 req-db6aaa5a-f1bf-4096-8c8c-1313eaea7b9d service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:59.071044 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-84d4f24b-4eb0-4099-9e30-6b9816d83156 req-db6aaa5a-f1bf-4096-8c8c-1313eaea7b9d service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:59.088493 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-84d4f24b-4eb0-4099-9e30-6b9816d83156 req-db6aaa5a-f1bf-4096-8c8c-1313eaea7b9d service nova] Creating event network-vif-deleted:d4154cb8-50f5-4bb6-a532-639edec2c403 for instance e437667e-27e0-4c28-8bbd-206763b7d3bb on hv-cinder-86020 Oct 06 11:18:59.093620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-84d4f24b-4eb0-4099-9e30-6b9816d83156 req-db6aaa5a-f1bf-4096-8c8c-1313eaea7b9d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038102 Oct 06 11:18:59.094456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 565/1138] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:18:59.424611 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1e372631-80b0-4151-85c6-d8c1302f40da tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:59.425155 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1e372631-80b0-4151-85c6-d8c1302f40da tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:59.432462 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e372631-80b0-4151-85c6-d8c1302f40da tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:59.433063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e372631-80b0-4151-85c6-d8c1302f40da tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:59.433577 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e372631-80b0-4151-85c6-d8c1302f40da tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:59.434362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e372631-80b0-4151-85c6-d8c1302f40da tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:59.434898 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e372631-80b0-4151-85c6-d8c1302f40da tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:59.435423 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e372631-80b0-4151-85c6-d8c1302f40da tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:59.460983 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1e372631-80b0-4151-85c6-d8c1302f40da tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:18:59.538473 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1e372631-80b0-4151-85c6-d8c1302f40da tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "DELETE /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 204 len: 0 microversion: 2.1 time: 0.117672 Oct 06 11:18:59.539340 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 574/1139] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:18:59 2022] DELETE /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:18:59.547117 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:59.547978 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:59.548312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ed98748-f901-4bf1-945d-34cccc42fd6c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:18:59.549105 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ed98748-f901-4bf1-945d-34cccc42fd6c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:18:59.557470 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ed98748-f901-4bf1-945d-34cccc42fd6c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:59.558076 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ed98748-f901-4bf1-945d-34cccc42fd6c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:59.558598 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ed98748-f901-4bf1-945d-34cccc42fd6c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:59.559403 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ed98748-f901-4bf1-945d-34cccc42fd6c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:59.559992 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ed98748-f901-4bf1-945d-34cccc42fd6c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:59.560940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ed98748-f901-4bf1-945d-34cccc42fd6c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:59.569975 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:59.570994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:59.571566 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:59.572456 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:59.572986 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:59.573527 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:59.609561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:18:59.610620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:18:59.610620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:18:59.611940 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lazy-loading 'fault' on Instance uuid e437667e-27e0-4c28-8bbd-206763b7d3bb {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:18:59.659075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:18:59.671411 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bff2242b-8200-42e6-ac45-a799bf1d7d6d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1331 microversion: 2.1 time: 0.132801 Oct 06 11:18:59.672248 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 566/1140] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:18:59 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1331 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:18:59.765589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ed98748-f901-4bf1-945d-34cccc42fd6c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:18:59.774037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ed98748-f901-4bf1-945d-34cccc42fd6c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1576 microversion: 2.1 time: 0.230472 Oct 06 11:18:59.774646 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 575/1141] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:18:59 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:19:00.697112 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:00.697739 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:00.704276 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:00.704762 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:00.705202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:00.705952 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:00.706411 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:00.706837 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:00.740168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:00.740657 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:00.741107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:00.741561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lazy-loading 'fault' on Instance uuid e437667e-27e0-4c28-8bbd-206763b7d3bb {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:19:00.798313 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49ec441d-ed8c-4e53-826c-2326e712c816 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:00.799603 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49ec441d-ed8c-4e53-826c-2326e712c816 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:00.806134 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ec441d-ed8c-4e53-826c-2326e712c816 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:00.806624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ec441d-ed8c-4e53-826c-2326e712c816 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:00.807090 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ec441d-ed8c-4e53-826c-2326e712c816 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:00.807789 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ec441d-ed8c-4e53-826c-2326e712c816 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:00.808312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ec441d-ed8c-4e53-826c-2326e712c816 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:00.808740 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ec441d-ed8c-4e53-826c-2326e712c816 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:00.840404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:00.847333 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c9b3bd12-8731-4c1f-adc4-28ba75fc1fb1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 200 len: 1331 microversion: 2.1 time: 0.155220 Oct 06 11:19:00.847946 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 567/1142] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:00 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 1331 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:00.940491 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-49ec441d-ed8c-4e53-826c-2326e712c816 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:00.949131 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49ec441d-ed8c-4e53-826c-2326e712c816 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1576 microversion: 2.1 time: 0.154673 Oct 06 11:19:00.949717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 576/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:00 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:19:01.870968 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:01.871524 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:01.877785 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:01.878262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:01.878702 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:01.879392 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:01.879911 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:01.880488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:01.894384 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb HTTP/1.1 Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:19:01.895404 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:19:01.898003 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': 'e437667e-27e0-4c28-8bbd-206763b7d3bb'} Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:19:01.899328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:19:01.900988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:19:01.902689 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:19:01.902689 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aa6a7ee0-a5f0-4afc-b103-f2b6de8f0016 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 404 len: 111 microversion: 2.1 time: 0.031067 Oct 06 11:19:01.902689 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 568/1144] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:01 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:19:01.907134 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc6b06eb-692e-40bc-93ad-89bb29058010 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '.version_select at 0x7f92a6f48d30>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:01.927024 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc6b06eb-692e-40bc-93ad-89bb29058010 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-221963501" status: 202 len: 0 microversion: 2.1 time: 0.023538 Oct 06 11:19:01.927610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 577/1145] 10.222.0.52 () {58 vars in 1218 bytes} [Thu Oct 6 11:19:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-221963501 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:19:01.972298 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-544c40ca-3321-47df-9281-d574b942d53f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:01.972950 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-544c40ca-3321-47df-9281-d574b942d53f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:01.982251 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544c40ca-3321-47df-9281-d574b942d53f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:01.982740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544c40ca-3321-47df-9281-d574b942d53f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:01.983180 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544c40ca-3321-47df-9281-d574b942d53f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:01.984008 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544c40ca-3321-47df-9281-d574b942d53f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:01.984475 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544c40ca-3321-47df-9281-d574b942d53f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:01.984885 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544c40ca-3321-47df-9281-d574b942d53f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:02.061053 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-544c40ca-3321-47df-9281-d574b942d53f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:02.071330 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-544c40ca-3321-47df-9281-d574b942d53f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1509 microversion: 2.1 time: 0.102912 Oct 06 11:19:02.085022 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 569/1146] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:01 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1509 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:02.360959 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-de599f07-a8ea-492d-8921-b984f00cf77c req-f91b9e7b-2569-44a5-8a6b-cf12205ee2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847a7542-8658-4e05-85d3-98b8ceb6c9de", "name": "network-vif-deleted", "tag": "9f6fca2b-eaa7-4e9e-9cb7-a301ae5992e4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:02.372031 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-de599f07-a8ea-492d-8921-b984f00cf77c req-f91b9e7b-2569-44a5-8a6b-cf12205ee2f0 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:02.372522 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-de599f07-a8ea-492d-8921-b984f00cf77c req-f91b9e7b-2569-44a5-8a6b-cf12205ee2f0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:02.372951 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-de599f07-a8ea-492d-8921-b984f00cf77c req-f91b9e7b-2569-44a5-8a6b-cf12205ee2f0 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:02.384486 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-de599f07-a8ea-492d-8921-b984f00cf77c req-f91b9e7b-2569-44a5-8a6b-cf12205ee2f0 service nova] Creating event network-vif-deleted:9f6fca2b-eaa7-4e9e-9cb7-a301ae5992e4 for instance 847a7542-8658-4e05-85d3-98b8ceb6c9de on hv-cinder-86020 Oct 06 11:19:02.390519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-de599f07-a8ea-492d-8921-b984f00cf77c req-f91b9e7b-2569-44a5-8a6b-cf12205ee2f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032669 Oct 06 11:19:02.397837 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 578/1147] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:19:02.664376 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1912cdbb-f012-48be-9d5c-da0573cab4d9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: .version_select at 0x7f92a6fb3e50>, body: {"keypair": {"name": "tempest-keypair-572232762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOm7EEVMMjL/panMheKtI5E51tYdpeoSyomCjBfDBZb1OEbT7xeBNJ+iPMWveBZhd113iOllcnbNz1GMxiNSDLTdCY99hqawnY7rNylYbuFlXzAsbFNccwYvwXqIApmcHQ=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:02.680708 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-1912cdbb-f012-48be-9d5c-da0573cab4d9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:19:02.684706 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-1912cdbb-f012-48be-9d5c-da0573cab4d9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for user 4ad5a3ee5ab545e2893d4f6365f8f939 and project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:19:02.707034 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1912cdbb-f012-48be-9d5c-da0573cab4d9 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047186 Oct 06 11:19:02.707620 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 570/1148] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Oct 6 11:19:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:19:03.101924 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:03.102490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:03.114811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:03.124479 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:03.125409 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:03.126451 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:03.127224 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:03.127861 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:03.171449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:03.171969 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:03.172490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:03.172948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lazy-loading 'fault' on Instance uuid 847a7542-8658-4e05-85d3-98b8ceb6c9de {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:19:03.223675 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:03.234614 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef7b1054-f91c-457d-9da0-89dd17976a6d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 200 len: 1230 microversion: 2.1 time: 0.141068 Oct 06 11:19:03.235200 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 579/1149] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:03 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 1230 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:03.985808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-563938976", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d576013-5c41-470a-82ec-fbb07f6bd986"}], "security_groups": [{"name": "tempest-securitygroup--1019749297"}], "key_name": "tempest-keypair-572232762", "user_data": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:04.093968 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] validate_networks() for [('8d576013-5c41-470a-82ec-fbb07f6bd986', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:19:04.259547 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:04.260124 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:04.266395 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:04.266892 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:04.267339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:04.268073 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:04.268543 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:04.268973 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:04.283117 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] HTTP exception thrown: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Request method failure captured: Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de HTTP/1.1 Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjqcyfwMjL7orR4zRiIJTEsq55TYB8vhOBZKpWG7HJUxPMtAXrTrkQMh35rpmQ7uaAW2XOEB1QY6oPU8JvHXnOofc1D4wWZ-_-cJLJtNkwftWmqkbm8wiRoxQQLf1gO2kqkKRjdrZHxVGFuOlHq8MR8MHzpnSYBgUOc-TKvcIFbJ4M Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 0934343645484d01b9b48a40bbf0b671 Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:19:04.284811 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0934343645484d01b9b48a40bbf0b671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 0934343645484d01b9b48a40bbf0b671 Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1089288570-project Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: acf06fe641e94b5b91145ed230ac7213 Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1089288570-project Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:19:04.287176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '847a7542-8658-4e05-85d3-98b8ceb6c9de'} Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:19:04.288148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:19:04.289527 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:19:04.290771 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Returning 404 to user: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:19:04.290771 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4950689-feb4-46a3-b8dc-ab90ad673203 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 404 len: 111 microversion: 2.1 time: 0.031432 Oct 06 11:19:04.290771 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 580/1150] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:04 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 11:19:04.334717 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1091580173", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1768988469", "security_groups": [{"name": "tempest-secgroup-smoke-516401855"}], "block_device_mapping_v2": [{"uuid": "0aa58a74-4942-4910-b566-d4416875da93", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4328977c-615f-4aaa-a450-a9014d5b4970"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:04.456218 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] validate_networks() for [('4328977c-615f-4aaa-a450-a9014d5b4970', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:19:04.471650 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:19:04.472142 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:19:04.472625 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:19:04.473038 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:19:04.473475 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:19:04.482869 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:04.483353 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:04.483787 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:04.484606 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:04.485062 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:04.485486 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:04.502971 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:19:04.507492 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for user 4ad5a3ee5ab545e2893d4f6365f8f939 and project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:19:04.518455 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:19:04.520799 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:19:04.569491 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a688e8f0-9ddc-4b98-9d3e-fbe9c7b8b4bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.588399 Oct 06 11:19:04.570155 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 571/1151] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:19:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:19:04.581141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37c8feea-c54f-4b96-9eaf-fef23eec12cc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:04.581786 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37c8feea-c54f-4b96-9eaf-fef23eec12cc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:04.637493 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-37c8feea-c54f-4b96-9eaf-fef23eec12cc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:04.646443 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37c8feea-c54f-4b96-9eaf-fef23eec12cc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1240 microversion: 2.1 time: 0.068297 Oct 06 11:19:04.647583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 572/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:04 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:19:04.862409 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:19:04.862843 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:19:04.863323 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:19:04.863893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:19:04.864831 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:19:04.874551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:04.875040 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:04.875483 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:04.876265 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:04.876726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:04.877159 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:04.894726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Getting quotas for project 0934343645484d01b9b48a40bbf0b671. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:19:04.899370 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Getting quotas for user acf06fe641e94b5b91145ed230ac7213 and project 0934343645484d01b9b48a40bbf0b671. Resources: {'instances', 'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:19:04.961484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:19:04.963654 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0aa58a74-4942-4910-b566-d4416875da93',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:19:05.097464 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7670feee-f1f8-4e30-b543-9cbe16ae6e5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.766690 Oct 06 11:19:05.098114 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 581/1153] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:19:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 11:19:05.110120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1ec29d01-918d-4d51-9b12-31dabb5b75a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:05.110743 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1ec29d01-918d-4d51-9b12-31dabb5b75a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:05.186919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1ec29d01-918d-4d51-9b12-31dabb5b75a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:05.195085 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1ec29d01-918d-4d51-9b12-31dabb5b75a2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1095 microversion: 2.1 time: 0.088812 Oct 06 11:19:05.196048 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 573/1154] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:05 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1095 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:05.670984 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7087b589-ef8d-4ea3-9509-b56484ccec44 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:05.671538 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7087b589-ef8d-4ea3-9509-b56484ccec44 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:05.678449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7087b589-ef8d-4ea3-9509-b56484ccec44 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:05.678927 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7087b589-ef8d-4ea3-9509-b56484ccec44 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:05.679359 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7087b589-ef8d-4ea3-9509-b56484ccec44 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:05.680085 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7087b589-ef8d-4ea3-9509-b56484ccec44 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:05.680557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7087b589-ef8d-4ea3-9509-b56484ccec44 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:05.680966 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7087b589-ef8d-4ea3-9509-b56484ccec44 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:05.784124 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7087b589-ef8d-4ea3-9509-b56484ccec44 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:05.793236 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7087b589-ef8d-4ea3-9509-b56484ccec44 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1300 microversion: 2.1 time: 0.126705 Oct 06 11:19:05.794300 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 582/1155] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:05 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:06.217861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aaab10f1-d0ef-4e67-bf14-c96d6b337c10 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:06.218520 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aaab10f1-d0ef-4e67-bf14-c96d6b337c10 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:06.225756 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaab10f1-d0ef-4e67-bf14-c96d6b337c10 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:06.226245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaab10f1-d0ef-4e67-bf14-c96d6b337c10 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:06.226695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaab10f1-d0ef-4e67-bf14-c96d6b337c10 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:06.227494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaab10f1-d0ef-4e67-bf14-c96d6b337c10 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:06.227980 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaab10f1-d0ef-4e67-bf14-c96d6b337c10 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:06.228414 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaab10f1-d0ef-4e67-bf14-c96d6b337c10 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:06.293098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-aaab10f1-d0ef-4e67-bf14-c96d6b337c10 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:06.302470 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aaab10f1-d0ef-4e67-bf14-c96d6b337c10 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1193 microversion: 2.1 time: 0.088116 Oct 06 11:19:06.303054 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 574/1156] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:06 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:06.817004 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ca964aa-efdb-460b-b5c3-97d61b950a67 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:06.818192 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4ca964aa-efdb-460b-b5c3-97d61b950a67 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:06.825365 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ca964aa-efdb-460b-b5c3-97d61b950a67 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:06.826125 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ca964aa-efdb-460b-b5c3-97d61b950a67 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:06.826576 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ca964aa-efdb-460b-b5c3-97d61b950a67 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:06.827288 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ca964aa-efdb-460b-b5c3-97d61b950a67 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:06.827998 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ca964aa-efdb-460b-b5c3-97d61b950a67 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:06.828586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ca964aa-efdb-460b-b5c3-97d61b950a67 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:06.847613 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:19:07.026843 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ca964aa-efdb-460b-b5c3-97d61b950a67 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:07.035511 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ca964aa-efdb-460b-b5c3-97d61b950a67 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1366 microversion: 2.1 time: 0.222316 Oct 06 11:19:07.036407 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 583/1157] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:06 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:07.326633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-781dc301-043a-414a-b0bb-a894f1514ff7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:07.328039 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-781dc301-043a-414a-b0bb-a894f1514ff7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:07.341675 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-781dc301-043a-414a-b0bb-a894f1514ff7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:07.342606 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-781dc301-043a-414a-b0bb-a894f1514ff7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:07.343621 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-781dc301-043a-414a-b0bb-a894f1514ff7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:07.345906 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-781dc301-043a-414a-b0bb-a894f1514ff7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:07.347098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-781dc301-043a-414a-b0bb-a894f1514ff7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:07.347243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-781dc301-043a-414a-b0bb-a894f1514ff7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:07.438690 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-718f44d8-b127-4c3f-8940-4bc82f1aaefa req-5b9c3d63-9142-4aec-91f2-0daf9db0534e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "605e2ba5-ae23-430e-a8a5-439650222ad4", "tag": "818b712e-b370-45de-919c-0b00b646f201"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:07.454810 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-718f44d8-b127-4c3f-8940-4bc82f1aaefa req-5b9c3d63-9142-4aec-91f2-0daf9db0534e service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:07.455897 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-718f44d8-b127-4c3f-8940-4bc82f1aaefa req-5b9c3d63-9142-4aec-91f2-0daf9db0534e service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:07.456609 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-718f44d8-b127-4c3f-8940-4bc82f1aaefa req-5b9c3d63-9142-4aec-91f2-0daf9db0534e service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:07.488586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-718f44d8-b127-4c3f-8940-4bc82f1aaefa req-5b9c3d63-9142-4aec-91f2-0daf9db0534e service nova] Creating event network-changed:818b712e-b370-45de-919c-0b00b646f201 for instance 605e2ba5-ae23-430e-a8a5-439650222ad4 on hv-cinder-86020 Oct 06 11:19:07.494194 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-718f44d8-b127-4c3f-8940-4bc82f1aaefa req-5b9c3d63-9142-4aec-91f2-0daf9db0534e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062399 Oct 06 11:19:07.494786 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 584/1158] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:19:07.604872 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-781dc301-043a-414a-b0bb-a894f1514ff7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:07.615649 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-781dc301-043a-414a-b0bb-a894f1514ff7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1278 microversion: 2.1 time: 0.292771 Oct 06 11:19:07.616273 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 575/1159] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:07 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1278 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:07.988236 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9c5b0958-d489-4393-ab7d-d9e2541b8f1a req-e35af5a0-3e22-4370-8860-2b594bede2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d4e7b17-b1e6-4e0c-af11-16d20efb530d", "tag": "540e5da9-dcce-45db-b59c-83443ed6141e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:07.998911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9c5b0958-d489-4393-ab7d-d9e2541b8f1a req-e35af5a0-3e22-4370-8860-2b594bede2f6 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:07.999469 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9c5b0958-d489-4393-ab7d-d9e2541b8f1a req-e35af5a0-3e22-4370-8860-2b594bede2f6 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:08.000238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9c5b0958-d489-4393-ab7d-d9e2541b8f1a req-e35af5a0-3e22-4370-8860-2b594bede2f6 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:08.011218 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9c5b0958-d489-4393-ab7d-d9e2541b8f1a req-e35af5a0-3e22-4370-8860-2b594bede2f6 service nova] Creating event network-changed:540e5da9-dcce-45db-b59c-83443ed6141e for instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d on hv-cinder-86020 Oct 06 11:19:08.015978 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9c5b0958-d489-4393-ab7d-d9e2541b8f1a req-e35af5a0-3e22-4370-8860-2b594bede2f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032229 Oct 06 11:19:08.016784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 585/1160] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:19:08.059353 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-07a732ee-6582-4dfd-993a-931572d28881 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:08.060025 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-07a732ee-6582-4dfd-993a-931572d28881 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:08.065926 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07a732ee-6582-4dfd-993a-931572d28881 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:08.066345 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07a732ee-6582-4dfd-993a-931572d28881 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:08.066778 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07a732ee-6582-4dfd-993a-931572d28881 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:08.067598 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07a732ee-6582-4dfd-993a-931572d28881 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:08.068081 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07a732ee-6582-4dfd-993a-931572d28881 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:08.068503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07a732ee-6582-4dfd-993a-931572d28881 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:08.086077 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:19:08.202290 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-07a732ee-6582-4dfd-993a-931572d28881 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:08.210339 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-07a732ee-6582-4dfd-993a-931572d28881 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1366 microversion: 2.1 time: 0.154730 Oct 06 11:19:08.210919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 576/1161] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:08 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:08.640639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5ba6749-d0a8-4ab3-9a06-553b6aa9cd20 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:08.641417 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5ba6749-d0a8-4ab3-9a06-553b6aa9cd20 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:08.648468 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ba6749-d0a8-4ab3-9a06-553b6aa9cd20 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:08.648948 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ba6749-d0a8-4ab3-9a06-553b6aa9cd20 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:08.649380 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ba6749-d0a8-4ab3-9a06-553b6aa9cd20 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:08.650064 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ba6749-d0a8-4ab3-9a06-553b6aa9cd20 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:08.650517 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ba6749-d0a8-4ab3-9a06-553b6aa9cd20 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:08.650939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ba6749-d0a8-4ab3-9a06-553b6aa9cd20 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:08.783434 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5ba6749-d0a8-4ab3-9a06-553b6aa9cd20 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:08.791222 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5ba6749-d0a8-4ab3-9a06-553b6aa9cd20 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.154958 Oct 06 11:19:08.791796 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 586/1162] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:08 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:09.233530 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1055372-1ea7-44c6-ac92-3ce3f2a0b780 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:09.234156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1055372-1ea7-44c6-ac92-3ce3f2a0b780 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:09.241609 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1055372-1ea7-44c6-ac92-3ce3f2a0b780 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:09.242099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1055372-1ea7-44c6-ac92-3ce3f2a0b780 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:09.242541 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1055372-1ea7-44c6-ac92-3ce3f2a0b780 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:09.243266 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1055372-1ea7-44c6-ac92-3ce3f2a0b780 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:09.243728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1055372-1ea7-44c6-ac92-3ce3f2a0b780 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:09.244185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1055372-1ea7-44c6-ac92-3ce3f2a0b780 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:09.369652 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1055372-1ea7-44c6-ac92-3ce3f2a0b780 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:09.377260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1055372-1ea7-44c6-ac92-3ce3f2a0b780 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1366 microversion: 2.1 time: 0.147640 Oct 06 11:19:09.377833 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 577/1163] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:09 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:09.814162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5dda7fc4-22a7-4f45-bfdf-7ed601deaefa tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:09.814782 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5dda7fc4-22a7-4f45-bfdf-7ed601deaefa tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:09.821301 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dda7fc4-22a7-4f45-bfdf-7ed601deaefa tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:09.821784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dda7fc4-22a7-4f45-bfdf-7ed601deaefa tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:09.822227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dda7fc4-22a7-4f45-bfdf-7ed601deaefa tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:09.822933 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dda7fc4-22a7-4f45-bfdf-7ed601deaefa tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:09.823392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dda7fc4-22a7-4f45-bfdf-7ed601deaefa tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:09.823818 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dda7fc4-22a7-4f45-bfdf-7ed601deaefa tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:09.954332 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5dda7fc4-22a7-4f45-bfdf-7ed601deaefa tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:09.962634 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5dda7fc4-22a7-4f45-bfdf-7ed601deaefa tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.152370 Oct 06 11:19:09.963198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 587/1164] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:09 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:10.402738 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b8006012-dc11-4a58-be32-d60a401f82fb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:10.404024 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b8006012-dc11-4a58-be32-d60a401f82fb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:10.410851 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8006012-dc11-4a58-be32-d60a401f82fb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:10.411548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8006012-dc11-4a58-be32-d60a401f82fb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:10.412033 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8006012-dc11-4a58-be32-d60a401f82fb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:10.412778 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8006012-dc11-4a58-be32-d60a401f82fb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:10.413238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8006012-dc11-4a58-be32-d60a401f82fb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:10.413667 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8006012-dc11-4a58-be32-d60a401f82fb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:10.632701 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b8006012-dc11-4a58-be32-d60a401f82fb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:10.640798 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b8006012-dc11-4a58-be32-d60a401f82fb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1366 microversion: 2.1 time: 0.243584 Oct 06 11:19:10.641449 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 578/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:10 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:10.986015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7fe0f38-29f5-4212-8523-903ec5402f08 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:10.986636 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7fe0f38-29f5-4212-8523-903ec5402f08 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:10.993807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0f38-29f5-4212-8523-903ec5402f08 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:10.994299 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0f38-29f5-4212-8523-903ec5402f08 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:10.994742 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0f38-29f5-4212-8523-903ec5402f08 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:10.995447 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0f38-29f5-4212-8523-903ec5402f08 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:10.995936 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0f38-29f5-4212-8523-903ec5402f08 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:10.996371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0f38-29f5-4212-8523-903ec5402f08 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:11.124404 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e7fe0f38-29f5-4212-8523-903ec5402f08 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:11.132621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7fe0f38-29f5-4212-8523-903ec5402f08 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.150472 Oct 06 11:19:11.133197 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 588/1166] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:10 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:11.665135 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49c39960-63dc-4063-a388-409419b8bfdc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:11.665684 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49c39960-63dc-4063-a388-409419b8bfdc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:11.672190 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49c39960-63dc-4063-a388-409419b8bfdc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:11.672681 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49c39960-63dc-4063-a388-409419b8bfdc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:11.673121 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49c39960-63dc-4063-a388-409419b8bfdc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:11.673821 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49c39960-63dc-4063-a388-409419b8bfdc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:11.674283 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49c39960-63dc-4063-a388-409419b8bfdc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:11.674700 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49c39960-63dc-4063-a388-409419b8bfdc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:12.043883 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-49c39960-63dc-4063-a388-409419b8bfdc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:12.051441 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49c39960-63dc-4063-a388-409419b8bfdc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1366 microversion: 2.1 time: 0.390375 Oct 06 11:19:12.052098 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 579/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:11 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:19:12.157168 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6faaf44a-a82d-481e-88f0-038652b60b79 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:12.157782 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6faaf44a-a82d-481e-88f0-038652b60b79 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:12.164436 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6faaf44a-a82d-481e-88f0-038652b60b79 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:12.164924 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6faaf44a-a82d-481e-88f0-038652b60b79 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:12.165362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6faaf44a-a82d-481e-88f0-038652b60b79 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:12.166057 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6faaf44a-a82d-481e-88f0-038652b60b79 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:12.166512 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6faaf44a-a82d-481e-88f0-038652b60b79 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:12.166932 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6faaf44a-a82d-481e-88f0-038652b60b79 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:12.293826 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6faaf44a-a82d-481e-88f0-038652b60b79 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:12.301385 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6faaf44a-a82d-481e-88f0-038652b60b79 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.148129 Oct 06 11:19:12.302489 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 589/1168] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:12 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:13.074001 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2d39b511-ab30-42ac-986c-6697cac22ee2 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:13.074553 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2d39b511-ab30-42ac-986c-6697cac22ee2 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:13.080897 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d39b511-ab30-42ac-986c-6697cac22ee2 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:13.081374 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d39b511-ab30-42ac-986c-6697cac22ee2 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:13.081810 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d39b511-ab30-42ac-986c-6697cac22ee2 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:13.082495 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d39b511-ab30-42ac-986c-6697cac22ee2 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:13.083474 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d39b511-ab30-42ac-986c-6697cac22ee2 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:13.084025 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d39b511-ab30-42ac-986c-6697cac22ee2 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:13.211130 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2d39b511-ab30-42ac-986c-6697cac22ee2 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:13.218973 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2d39b511-ab30-42ac-986c-6697cac22ee2 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1366 microversion: 2.1 time: 0.148987 Oct 06 11:19:13.219548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 580/1169] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:13 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:13.324372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d55149a3-1d16-4062-aa29-ca4a89a1bc31 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:13.324923 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d55149a3-1d16-4062-aa29-ca4a89a1bc31 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:13.331216 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d55149a3-1d16-4062-aa29-ca4a89a1bc31 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:13.331713 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d55149a3-1d16-4062-aa29-ca4a89a1bc31 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:13.332193 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d55149a3-1d16-4062-aa29-ca4a89a1bc31 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:13.333554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d55149a3-1d16-4062-aa29-ca4a89a1bc31 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:13.334140 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d55149a3-1d16-4062-aa29-ca4a89a1bc31 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:13.334571 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d55149a3-1d16-4062-aa29-ca4a89a1bc31 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:13.472563 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d55149a3-1d16-4062-aa29-ca4a89a1bc31 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:13.480514 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d55149a3-1d16-4062-aa29-ca4a89a1bc31 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.159932 Oct 06 11:19:13.481312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 590/1170] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:13 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:13.560328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-47ea4c2d-3a7c-4e6a-8a06-8f49f1ec637e req-f4ecf05e-efc9-40b1-a9ad-b4ad50d68345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "605e2ba5-ae23-430e-a8a5-439650222ad4", "name": "network-vif-plugged", "status": "completed", "tag": "818b712e-b370-45de-919c-0b00b646f201"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:13.570626 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-47ea4c2d-3a7c-4e6a-8a06-8f49f1ec637e req-f4ecf05e-efc9-40b1-a9ad-b4ad50d68345 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:13.571122 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-47ea4c2d-3a7c-4e6a-8a06-8f49f1ec637e req-f4ecf05e-efc9-40b1-a9ad-b4ad50d68345 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:13.571636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-47ea4c2d-3a7c-4e6a-8a06-8f49f1ec637e req-f4ecf05e-efc9-40b1-a9ad-b4ad50d68345 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:13.582593 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-47ea4c2d-3a7c-4e6a-8a06-8f49f1ec637e req-f4ecf05e-efc9-40b1-a9ad-b4ad50d68345 service nova] Creating event network-vif-plugged:818b712e-b370-45de-919c-0b00b646f201 for instance 605e2ba5-ae23-430e-a8a5-439650222ad4 on hv-cinder-86020 Oct 06 11:19:13.588655 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-47ea4c2d-3a7c-4e6a-8a06-8f49f1ec637e req-f4ecf05e-efc9-40b1-a9ad-b4ad50d68345 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031967 Oct 06 11:19:13.589247 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 581/1171] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:19:14.243083 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8fba6666-8c50-4858-8244-bedc0ca5d534 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:14.243670 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8fba6666-8c50-4858-8244-bedc0ca5d534 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:14.249605 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fba6666-8c50-4858-8244-bedc0ca5d534 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:14.250119 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fba6666-8c50-4858-8244-bedc0ca5d534 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:14.250551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fba6666-8c50-4858-8244-bedc0ca5d534 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:14.251237 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fba6666-8c50-4858-8244-bedc0ca5d534 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:14.251688 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fba6666-8c50-4858-8244-bedc0ca5d534 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:14.252147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fba6666-8c50-4858-8244-bedc0ca5d534 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:14.500598 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:19:14.504720 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a151f36a-07fd-4c23-b113-ef943a4a13e2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:14.505441 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a151f36a-07fd-4c23-b113-ef943a4a13e2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:14.508545 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:19:14.513367 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a151f36a-07fd-4c23-b113-ef943a4a13e2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:14.513864 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a151f36a-07fd-4c23-b113-ef943a4a13e2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:14.514305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a151f36a-07fd-4c23-b113-ef943a4a13e2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:14.515019 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a151f36a-07fd-4c23-b113-ef943a4a13e2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:14.515472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a151f36a-07fd-4c23-b113-ef943a4a13e2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:14.515928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a151f36a-07fd-4c23-b113-ef943a4a13e2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:14.640975 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fba6666-8c50-4858-8244-bedc0ca5d534 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:14.649886 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8fba6666-8c50-4858-8244-bedc0ca5d534 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1366 microversion: 2.1 time: 0.411265 Oct 06 11:19:14.650558 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 591/1172] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:14 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1366 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:14.657561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-a151f36a-07fd-4c23-b113-ef943a4a13e2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:14.665879 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a151f36a-07fd-4c23-b113-ef943a4a13e2 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.166912 Oct 06 11:19:14.666437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 582/1173] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:14 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:19:15.674546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7da63072-351b-41bd-b752-e2b42d15170e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:15.675165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7da63072-351b-41bd-b752-e2b42d15170e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:15.677249 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:19:15.678041 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:19:15.684238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7da63072-351b-41bd-b752-e2b42d15170e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:15.684815 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7da63072-351b-41bd-b752-e2b42d15170e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:15.685264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7da63072-351b-41bd-b752-e2b42d15170e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:15.686050 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7da63072-351b-41bd-b752-e2b42d15170e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:15.686426 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7da63072-351b-41bd-b752-e2b42d15170e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:15.686857 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7da63072-351b-41bd-b752-e2b42d15170e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:15.689705 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c67427df-a84f-46a4-bf51-b27ce8aef8d9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:15.690477 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c67427df-a84f-46a4-bf51-b27ce8aef8d9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:15.692950 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=14 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:19:15.698915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c67427df-a84f-46a4-bf51-b27ce8aef8d9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:15.699396 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c67427df-a84f-46a4-bf51-b27ce8aef8d9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:15.699829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c67427df-a84f-46a4-bf51-b27ce8aef8d9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:15.700589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c67427df-a84f-46a4-bf51-b27ce8aef8d9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:15.701040 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c67427df-a84f-46a4-bf51-b27ce8aef8d9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:15.701459 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c67427df-a84f-46a4-bf51-b27ce8aef8d9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:15.819439 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7da63072-351b-41bd-b752-e2b42d15170e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:15.828411 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7da63072-351b-41bd-b752-e2b42d15170e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1555 microversion: 2.1 time: 0.157360 Oct 06 11:19:15.828992 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 592/1174] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:15 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:15.836988 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c67427df-a84f-46a4-bf51-b27ce8aef8d9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:15.844641 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c67427df-a84f-46a4-bf51-b27ce8aef8d9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.158776 Oct 06 11:19:15.845197 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 583/1175] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:15 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:19:15.851216 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8545185c-dd13-4907-8623-6ac5e4699787 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:15.851774 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8545185c-dd13-4907-8623-6ac5e4699787 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:15.857677 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8545185c-dd13-4907-8623-6ac5e4699787 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:15.858244 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8545185c-dd13-4907-8623-6ac5e4699787 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:15.858763 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8545185c-dd13-4907-8623-6ac5e4699787 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:15.859541 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8545185c-dd13-4907-8623-6ac5e4699787 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:15.860032 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8545185c-dd13-4907-8623-6ac5e4699787 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:15.860459 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8545185c-dd13-4907-8623-6ac5e4699787 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:15.940853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8545185c-dd13-4907-8623-6ac5e4699787 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093399 Oct 06 11:19:15.941450 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 593/1176] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Oct 6 11:19:15 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:19:16.862136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7fb86a0d-5f83-4dbe-8093-0d8ab379fcab req-af4ab671-c124-481e-a5e1-53ebb3952db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "605e2ba5-ae23-430e-a8a5-439650222ad4", "tag": "818b712e-b370-45de-919c-0b00b646f201"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:16.869541 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6cbad995-c820-422c-82fd-9161a8d2f481 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:16.870067 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6cbad995-c820-422c-82fd-9161a8d2f481 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:16.873639 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7fb86a0d-5f83-4dbe-8093-0d8ab379fcab req-af4ab671-c124-481e-a5e1-53ebb3952db6 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:16.874131 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7fb86a0d-5f83-4dbe-8093-0d8ab379fcab req-af4ab671-c124-481e-a5e1-53ebb3952db6 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:16.874561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7fb86a0d-5f83-4dbe-8093-0d8ab379fcab req-af4ab671-c124-481e-a5e1-53ebb3952db6 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:16.876052 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cbad995-c820-422c-82fd-9161a8d2f481 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:16.876599 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cbad995-c820-422c-82fd-9161a8d2f481 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:16.877064 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cbad995-c820-422c-82fd-9161a8d2f481 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:16.877776 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cbad995-c820-422c-82fd-9161a8d2f481 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:16.878235 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cbad995-c820-422c-82fd-9161a8d2f481 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:16.879270 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cbad995-c820-422c-82fd-9161a8d2f481 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:16.886604 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7fb86a0d-5f83-4dbe-8093-0d8ab379fcab req-af4ab671-c124-481e-a5e1-53ebb3952db6 service nova] Creating event network-changed:818b712e-b370-45de-919c-0b00b646f201 for instance 605e2ba5-ae23-430e-a8a5-439650222ad4 on hv-cinder-86020 Oct 06 11:19:16.891815 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7fb86a0d-5f83-4dbe-8093-0d8ab379fcab req-af4ab671-c124-481e-a5e1-53ebb3952db6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033412 Oct 06 11:19:16.892783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 584/1177] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:19:17.026277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6cbad995-c820-422c-82fd-9161a8d2f481 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:17.034156 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6cbad995-c820-422c-82fd-9161a8d2f481 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.169886 Oct 06 11:19:17.034740 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 594/1178] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:16 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:19:18.059112 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d34fd2b3-5258-42c0-98a5-291974ec5865 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:18.059972 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d34fd2b3-5258-42c0-98a5-291974ec5865 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:18.066403 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d34fd2b3-5258-42c0-98a5-291974ec5865 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:18.067017 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d34fd2b3-5258-42c0-98a5-291974ec5865 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:18.068150 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d34fd2b3-5258-42c0-98a5-291974ec5865 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:18.068936 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d34fd2b3-5258-42c0-98a5-291974ec5865 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:18.069462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d34fd2b3-5258-42c0-98a5-291974ec5865 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:18.070091 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d34fd2b3-5258-42c0-98a5-291974ec5865 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:18.213840 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d34fd2b3-5258-42c0-98a5-291974ec5865 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:18.221551 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d34fd2b3-5258-42c0-98a5-291974ec5865 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.168115 Oct 06 11:19:18.222117 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 585/1179] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:18 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:19.244715 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70e756f2-a9e6-46a1-8967-0eb8449f3e18 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:19.245555 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70e756f2-a9e6-46a1-8967-0eb8449f3e18 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:19.251754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e756f2-a9e6-46a1-8967-0eb8449f3e18 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:19.252269 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e756f2-a9e6-46a1-8967-0eb8449f3e18 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:19.252702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e756f2-a9e6-46a1-8967-0eb8449f3e18 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:19.253396 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e756f2-a9e6-46a1-8967-0eb8449f3e18 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:19.253853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e756f2-a9e6-46a1-8967-0eb8449f3e18 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:19.254277 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e756f2-a9e6-46a1-8967-0eb8449f3e18 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:19.381621 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-70e756f2-a9e6-46a1-8967-0eb8449f3e18 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:19.389325 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70e756f2-a9e6-46a1-8967-0eb8449f3e18 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.148411 Oct 06 11:19:19.389895 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 595/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:19 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:20.413825 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa17dc24-64df-4b2c-b40f-6e1ec2fe7858 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:20.414451 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa17dc24-64df-4b2c-b40f-6e1ec2fe7858 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:20.420872 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa17dc24-64df-4b2c-b40f-6e1ec2fe7858 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:20.421365 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa17dc24-64df-4b2c-b40f-6e1ec2fe7858 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:20.421809 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa17dc24-64df-4b2c-b40f-6e1ec2fe7858 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:20.422512 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa17dc24-64df-4b2c-b40f-6e1ec2fe7858 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:20.422970 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa17dc24-64df-4b2c-b40f-6e1ec2fe7858 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:20.423402 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa17dc24-64df-4b2c-b40f-6e1ec2fe7858 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:20.554125 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa17dc24-64df-4b2c-b40f-6e1ec2fe7858 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:20.561736 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa17dc24-64df-4b2c-b40f-6e1ec2fe7858 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.152554 Oct 06 11:19:20.562301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 586/1181] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:20 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:21.584681 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b33e6623-d425-4677-b53d-660d2288b304 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:21.585350 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b33e6623-d425-4677-b53d-660d2288b304 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:21.587989 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:19:21.593451 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33e6623-d425-4677-b53d-660d2288b304 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:21.593935 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33e6623-d425-4677-b53d-660d2288b304 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:21.594374 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33e6623-d425-4677-b53d-660d2288b304 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:21.595071 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33e6623-d425-4677-b53d-660d2288b304 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:21.595519 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33e6623-d425-4677-b53d-660d2288b304 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:21.595986 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33e6623-d425-4677-b53d-660d2288b304 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:21.596519 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-11a258f8-4f7d-4f88-bb08-343033061cbb req-2e637ae2-bd5e-4109-9549-5c58524bd0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4e7b17-b1e6-4e0c-af11-16d20efb530d", "name": "network-vif-plugged", "status": "completed", "tag": "540e5da9-dcce-45db-b59c-83443ed6141e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:21.607708 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-11a258f8-4f7d-4f88-bb08-343033061cbb req-2e637ae2-bd5e-4109-9549-5c58524bd0fb service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:21.608233 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-11a258f8-4f7d-4f88-bb08-343033061cbb req-2e637ae2-bd5e-4109-9549-5c58524bd0fb service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:21.608746 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-11a258f8-4f7d-4f88-bb08-343033061cbb req-2e637ae2-bd5e-4109-9549-5c58524bd0fb service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:21.622197 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-11a258f8-4f7d-4f88-bb08-343033061cbb req-2e637ae2-bd5e-4109-9549-5c58524bd0fb service nova] Creating event network-vif-plugged:540e5da9-dcce-45db-b59c-83443ed6141e for instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d on hv-cinder-86020 Oct 06 11:19:21.627229 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-11a258f8-4f7d-4f88-bb08-343033061cbb req-2e637ae2-bd5e-4109-9549-5c58524bd0fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034657 Oct 06 11:19:21.628435 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 587/1182] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:19:21.735211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b33e6623-d425-4677-b53d-660d2288b304 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:21.743162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b33e6623-d425-4677-b53d-660d2288b304 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.163060 Oct 06 11:19:21.743754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 596/1183] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:21 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:22.767513 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28ed7857-ce20-4bcf-89ed-6639111447d4 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:22.768253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-28ed7857-ce20-4bcf-89ed-6639111447d4 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:22.775159 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28ed7857-ce20-4bcf-89ed-6639111447d4 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:22.775647 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28ed7857-ce20-4bcf-89ed-6639111447d4 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:22.776128 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28ed7857-ce20-4bcf-89ed-6639111447d4 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:22.776823 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28ed7857-ce20-4bcf-89ed-6639111447d4 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:22.777280 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28ed7857-ce20-4bcf-89ed-6639111447d4 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:22.777713 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28ed7857-ce20-4bcf-89ed-6639111447d4 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:22.908438 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-28ed7857-ce20-4bcf-89ed-6639111447d4 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:22.916632 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28ed7857-ce20-4bcf-89ed-6639111447d4 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1266 microversion: 2.1 time: 0.153808 Oct 06 11:19:22.917195 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 588/1184] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:22 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:23.939169 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4546bce-948d-4068-a621-3fce1245eaf9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:23.939945 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c4546bce-948d-4068-a621-3fce1245eaf9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:23.946834 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4546bce-948d-4068-a621-3fce1245eaf9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:23.947320 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4546bce-948d-4068-a621-3fce1245eaf9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:23.947763 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4546bce-948d-4068-a621-3fce1245eaf9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:23.948499 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4546bce-948d-4068-a621-3fce1245eaf9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:23.948955 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4546bce-948d-4068-a621-3fce1245eaf9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:23.949379 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4546bce-948d-4068-a621-3fce1245eaf9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:24.114839 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c4546bce-948d-4068-a621-3fce1245eaf9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:24.122549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c4546bce-948d-4068-a621-3fce1245eaf9 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1454 microversion: 2.1 time: 0.187160 Oct 06 11:19:24.123055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 597/1185] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:23 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1454 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:24.146012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5577d92c-c459-4fc5-9810-1dec25cb7e91 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:24.146696 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5577d92c-c459-4fc5-9810-1dec25cb7e91 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:24.152997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5577d92c-c459-4fc5-9810-1dec25cb7e91 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:24.153484 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5577d92c-c459-4fc5-9810-1dec25cb7e91 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:24.153926 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5577d92c-c459-4fc5-9810-1dec25cb7e91 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:24.154626 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5577d92c-c459-4fc5-9810-1dec25cb7e91 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:24.155081 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5577d92c-c459-4fc5-9810-1dec25cb7e91 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:24.155508 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5577d92c-c459-4fc5-9810-1dec25cb7e91 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:24.301413 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-5577d92c-c459-4fc5-9810-1dec25cb7e91 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:24.309670 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5577d92c-c459-4fc5-9810-1dec25cb7e91 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1454 microversion: 2.1 time: 0.167499 Oct 06 11:19:24.310243 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 589/1186] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:24 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:24.602863 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad727909-ed9a-4857-8372-7daec6ccc367 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:24.603362 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad727909-ed9a-4857-8372-7daec6ccc367 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:24.605922 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-4d8f8166-9eb7-414c-91ab-0eee24c4f3cd req-7c4bbf07-9f6e-40a7-bd69-0e8a8ea682ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6e0b3e-d553-4434-8a4f-b70e545a33f8", "tag": "b4073667-1fd2-4402-b6cb-c6a7057072a4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:24.609543 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad727909-ed9a-4857-8372-7daec6ccc367 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:24.610031 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad727909-ed9a-4857-8372-7daec6ccc367 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:24.610465 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad727909-ed9a-4857-8372-7daec6ccc367 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:24.611176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad727909-ed9a-4857-8372-7daec6ccc367 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:24.611640 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad727909-ed9a-4857-8372-7daec6ccc367 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:24.612126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad727909-ed9a-4857-8372-7daec6ccc367 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:24.625049 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4d8f8166-9eb7-414c-91ab-0eee24c4f3cd req-7c4bbf07-9f6e-40a7-bd69-0e8a8ea682ee service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:24.625448 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4d8f8166-9eb7-414c-91ab-0eee24c4f3cd req-7c4bbf07-9f6e-40a7-bd69-0e8a8ea682ee service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:24.626586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4d8f8166-9eb7-414c-91ab-0eee24c4f3cd req-7c4bbf07-9f6e-40a7-bd69-0e8a8ea682ee service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:24.638751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad727909-ed9a-4857-8372-7daec6ccc367 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:19:24.640426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-4d8f8166-9eb7-414c-91ab-0eee24c4f3cd req-7c4bbf07-9f6e-40a7-bd69-0e8a8ea682ee service nova] Creating event network-changed:b4073667-1fd2-4402-b6cb-c6a7057072a4 for instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 on hv-cinder-86020 Oct 06 11:19:24.648150 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-4d8f8166-9eb7-414c-91ab-0eee24c4f3cd req-7c4bbf07-9f6e-40a7-bd69-0e8a8ea682ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045733 Oct 06 11:19:24.653002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 590/1187] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:19:24.769207 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad727909-ed9a-4857-8372-7daec6ccc367 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 204 len: 0 microversion: 2.1 time: 0.170169 Oct 06 11:19:24.773626 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 598/1188] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:19:24 2022] DELETE /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:19:24.782689 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2bf2126f-07d4-4b4f-8e58-093c35b38bdf tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:24.783723 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2bf2126f-07d4-4b4f-8e58-093c35b38bdf tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:24.791796 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bf2126f-07d4-4b4f-8e58-093c35b38bdf tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:24.792849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bf2126f-07d4-4b4f-8e58-093c35b38bdf tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:24.793624 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bf2126f-07d4-4b4f-8e58-093c35b38bdf tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:24.795535 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bf2126f-07d4-4b4f-8e58-093c35b38bdf tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:24.796188 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bf2126f-07d4-4b4f-8e58-093c35b38bdf tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:24.796871 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bf2126f-07d4-4b4f-8e58-093c35b38bdf tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:25.040375 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2bf2126f-07d4-4b4f-8e58-093c35b38bdf tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:25.048238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2bf2126f-07d4-4b4f-8e58-093c35b38bdf tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.272215 Oct 06 11:19:25.056937 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 591/1189] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:24 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:26.057657 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-63480061-0662-4be2-98f7-1066b453280a req-cd2340e9-5cee-4f97-a66e-d3bd31274f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d4e7b17-b1e6-4e0c-af11-16d20efb530d", "tag": "540e5da9-dcce-45db-b59c-83443ed6141e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:26.067701 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-63480061-0662-4be2-98f7-1066b453280a req-cd2340e9-5cee-4f97-a66e-d3bd31274f97 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:26.068707 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-63480061-0662-4be2-98f7-1066b453280a req-cd2340e9-5cee-4f97-a66e-d3bd31274f97 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:26.068846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-63480061-0662-4be2-98f7-1066b453280a req-cd2340e9-5cee-4f97-a66e-d3bd31274f97 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:26.071183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc5578df-b88f-46ae-af36-f8fe6fb21be0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:26.071682 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc5578df-b88f-46ae-af36-f8fe6fb21be0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:26.078391 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc5578df-b88f-46ae-af36-f8fe6fb21be0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:26.079109 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc5578df-b88f-46ae-af36-f8fe6fb21be0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:26.079703 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc5578df-b88f-46ae-af36-f8fe6fb21be0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:26.080434 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-63480061-0662-4be2-98f7-1066b453280a req-cd2340e9-5cee-4f97-a66e-d3bd31274f97 service nova] Creating event network-changed:540e5da9-dcce-45db-b59c-83443ed6141e for instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d on hv-cinder-86020 Oct 06 11:19:26.080810 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc5578df-b88f-46ae-af36-f8fe6fb21be0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:26.081262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc5578df-b88f-46ae-af36-f8fe6fb21be0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:26.084217 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc5578df-b88f-46ae-af36-f8fe6fb21be0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:26.087102 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-63480061-0662-4be2-98f7-1066b453280a req-cd2340e9-5cee-4f97-a66e-d3bd31274f97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032079 Oct 06 11:19:26.087102 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 599/1190] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:19:26.229219 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-dc5578df-b88f-46ae-af36-f8fe6fb21be0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:26.237459 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc5578df-b88f-46ae-af36-f8fe6fb21be0 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1569 microversion: 2.1 time: 0.170261 Oct 06 11:19:26.238267 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 592/1191] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:26 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:19:27.088720 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f42d8504-3a30-4434-8f31-8564f6991278 req-1a82ca5a-2e57-49d3-9a4b-ddf35f29fe6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6e0b3e-d553-4434-8a4f-b70e545a33f8", "name": "network-vif-deleted", "tag": "b4073667-1fd2-4402-b6cb-c6a7057072a4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:19:27.099941 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f42d8504-3a30-4434-8f31-8564f6991278 req-1a82ca5a-2e57-49d3-9a4b-ddf35f29fe6f service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:27.100441 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f42d8504-3a30-4434-8f31-8564f6991278 req-1a82ca5a-2e57-49d3-9a4b-ddf35f29fe6f service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:27.100875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f42d8504-3a30-4434-8f31-8564f6991278 req-1a82ca5a-2e57-49d3-9a4b-ddf35f29fe6f service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:27.113467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f42d8504-3a30-4434-8f31-8564f6991278 req-1a82ca5a-2e57-49d3-9a4b-ddf35f29fe6f service nova] Creating event network-vif-deleted:b4073667-1fd2-4402-b6cb-c6a7057072a4 for instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 on hv-cinder-86020 Oct 06 11:19:27.119689 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f42d8504-3a30-4434-8f31-8564f6991278 req-1a82ca5a-2e57-49d3-9a4b-ddf35f29fe6f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034618 Oct 06 11:19:27.120644 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 600/1192] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:19:27.262500 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c9c4a85a-2ddf-4a67-9386-4b3fd7f97a70 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:27.263136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c9c4a85a-2ddf-4a67-9386-4b3fd7f97a70 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:27.269482 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c4a85a-2ddf-4a67-9386-4b3fd7f97a70 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:27.269961 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c4a85a-2ddf-4a67-9386-4b3fd7f97a70 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:27.270489 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c4a85a-2ddf-4a67-9386-4b3fd7f97a70 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:27.271548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c4a85a-2ddf-4a67-9386-4b3fd7f97a70 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:27.272282 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c4a85a-2ddf-4a67-9386-4b3fd7f97a70 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:27.272704 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c4a85a-2ddf-4a67-9386-4b3fd7f97a70 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:27.337152 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9c4a85a-2ddf-4a67-9386-4b3fd7f97a70 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00353b2edab47e79578de680e4c4d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376d8470a80416cb8e57eb650884883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:19:27.345390 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c9c4a85a-2ddf-4a67-9386-4b3fd7f97a70 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 200 len: 1219 microversion: 2.1 time: 0.086729 Oct 06 11:19:27.345959 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 593/1193] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:27 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:19:28.374021 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:28.374733 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] [instance: 4a6e0b3e-d553-4434-8a4f-b70e545a33f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:19:28.380866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:28.381349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:28.382347 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:28.383055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:19:28.383510 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:19:28.383961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:19:28.398152 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] HTTP exception thrown: Instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 could not be found. Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Request method failure captured: Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 HTTP/1.1 Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrhvxIW7qWX5Jjjm77Q4wkSQ3VV7Rypzi5uhaPa0aDlyayp7S0WZaaOPKZ33Pff642bG5obdbpHufWsG4SE35h8Bq9G4Iz5DEPDLNSx3t8aV4DnM2lQmlsfvhUFQANk_qhnX7MtjUuAsvGsLJPaJbtN5UzFDwE4EU9i79o0CD5KzfIQ Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 9376d8470a80416cb8e57eb650884883 Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-TestShelveInstance-1847309023 Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:19:28.399875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9376d8470a80416cb8e57eb650884883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9376d8470a80416cb8e57eb650884883"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9376d8470a80416cb8e57eb650884883"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9376d8470a80416cb8e57eb650884883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-TestShelveInstance-1847309023 Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 9376d8470a80416cb8e57eb650884883 Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestShelveInstance-1847309023 Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-TestShelveInstance-1847309023-project Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: e00353b2edab47e79578de680e4c4d1c Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-TestShelveInstance-1847309023-project Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 could not be found. Oct 06 11:19:28.401639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '4a6e0b3e-d553-4434-8a4f-b70e545a33f8'} Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 could not be found. Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:19:28.402618 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 could not be found. Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 could not be found. Oct 06 11:19:28.404037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:19:28.405337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Returning 404 to user: Instance 4a6e0b3e-d553-4434-8a4f-b70e545a33f8 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:19:28.405337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5b331102-9682-4d19-a940-0dbbc5152728 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8" status: 404 len: 111 microversion: 2.1 time: 0.032022 Oct 06 11:19:28.405337 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 601/1194] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:19:28 2022] GET /compute/v2.1/servers/4a6e0b3e-d553-4434-8a4f-b70e545a33f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:19:28.556157 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8010b33f-b33c-4e46-8b1b-15aea9b71423 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] Calling method '.version_select at 0x7f92a70ae8b0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:19:28.575785 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8010b33f-b33c-4e46-8b1b-15aea9b71423 tempest-TestShelveInstance-1847309023 tempest-TestShelveInstance-1847309023-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-528045492" status: 202 len: 0 microversion: 2.1 time: 0.023578 Oct 06 11:19:28.576399 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 594/1195] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Oct 6 11:19:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-528045492 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:20:32.946113 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:20:32.946846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:20:32.951859 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a5cd901-0af2-4cca-b877-c61be988830f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:32.952367 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a5cd901-0af2-4cca-b877-c61be988830f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:32.960908 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cd901-0af2-4cca-b877-c61be988830f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:32.961387 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cd901-0af2-4cca-b877-c61be988830f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:32.961821 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cd901-0af2-4cca-b877-c61be988830f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:32.962510 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cd901-0af2-4cca-b877-c61be988830f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:32.962968 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cd901-0af2-4cca-b877-c61be988830f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:32.963391 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cd901-0af2-4cca-b877-c61be988830f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:32.987656 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a5cd901-0af2-4cca-b877-c61be988830f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/ips" status: 200 len: 149 microversion: 2.1 time: 0.043457 Oct 06 11:20:32.988233 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 602/1196] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Oct 6 11:20:32 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:20:34.496503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=88 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:20:34.497237 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:20:34.503255 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1867536-9ae5-488f-9f34-952622ad7198 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1963f1c2-c4f7-451f-923e-8b75d4d4c3bb"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:20:34.505558 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1867536-9ae5-488f-9f34-952622ad7198 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:34.513917 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1867536-9ae5-488f-9f34-952622ad7198 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:34.514398 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1867536-9ae5-488f-9f34-952622ad7198 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:34.514829 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1867536-9ae5-488f-9f34-952622ad7198 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:34.515514 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1867536-9ae5-488f-9f34-952622ad7198 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:34.516004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1867536-9ae5-488f-9f34-952622ad7198 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:34.516412 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1867536-9ae5-488f-9f34-952622ad7198 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:34.780254 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1867536-9ae5-488f-9f34-952622ad7198 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285618 Oct 06 11:20:34.781059 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 595/1197] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:20:34 2022] POST /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:20:42.315739 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1963f1c2-c4f7-451f-923e-8b75d4d4c3bb"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:20:42.318161 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:42.324682 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:42.325166 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:42.325606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:42.326298 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:42.326752 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:42.327211 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:42.406555 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Invalid volume: volume 1963f1c2-c4f7-451f-923e-8b75d4d4c3bb is already attached to instances: 605e2ba5-ae23-430e-a8a5-439650222ad4 Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments HTTP/1.1 Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 74 Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:20:42.408198 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {"volumeAttachment": {"volumeId": "1963f1c2-c4f7-451f-923e-8b75d4d4c3bb"}} Oct 06 11:20:42.410006 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Invalid volume: volume 1963f1c2-c4f7-451f-923e-8b75d4d4c3bb is already attached to instances: 605e2ba5-ae23-430e-a8a5-439650222ad4 Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'server_id': '605e2ba5-ae23-430e-a8a5-439650222ad4', 'body': {'volumeAttachment': {'volumeId': '1963f1c2-c4f7-451f-923e-8b75d4d4c3bb'}}} Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1963f1c2-c4f7-451f-923e-8b75d4d4c3bb is already attached to instances: 605e2ba5-ae23-430e-a8a5-439650222ad4 Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:20:42.411241 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1963f1c2-c4f7-451f-923e-8b75d4d4c3bb is already attached to instances: 605e2ba5-ae23-430e-a8a5-439650222ad4 Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:20:42.412940 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:20:42.415327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:20:42.415327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:20:42.415327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:20:42.415327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1963f1c2-c4f7-451f-923e-8b75d4d4c3bb is already attached to instances: 605e2ba5-ae23-430e-a8a5-439650222ad4 Oct 06 11:20:42.415327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:20:42.415327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 400 to user: Invalid volume: volume 1963f1c2-c4f7-451f-923e-8b75d4d4c3bb is already attached to instances: 605e2ba5-ae23-430e-a8a5-439650222ad4 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:20:42.415327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e1c9082-7b97-426d-8b1e-0d723b946e87 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097919 Oct 06 11:20:42.415327 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 603/1198] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:20:42 2022] POST /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 11:20:42.477669 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f83620b8-64a5-4e4a-9686-837934d6f9a0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:42.478269 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f83620b8-64a5-4e4a-9686-837934d6f9a0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:42.484956 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f83620b8-64a5-4e4a-9686-837934d6f9a0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:42.485440 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f83620b8-64a5-4e4a-9686-837934d6f9a0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:42.485884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f83620b8-64a5-4e4a-9686-837934d6f9a0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:42.486583 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f83620b8-64a5-4e4a-9686-837934d6f9a0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:42.487043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f83620b8-64a5-4e4a-9686-837934d6f9a0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:42.487477 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f83620b8-64a5-4e4a-9686-837934d6f9a0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:42.566814 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-f83620b8-64a5-4e4a-9686-837934d6f9a0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lazy-loading 'services' on Instance uuid 605e2ba5-ae23-430e-a8a5-439650222ad4 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:20:42.637225 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f83620b8-64a5-4e4a-9686-837934d6f9a0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments/1963f1c2-c4f7-451f-923e-8b75d4d4c3bb" status: 202 len: 0 microversion: 2.1 time: 0.163846 Oct 06 11:20:42.637838 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 596/1199] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:20:42 2022] DELETE /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments/1963f1c2-c4f7-451f-923e-8b75d4d4c3bb => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:20:42.646089 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-633ba9bf-817b-4716-9c2a-f84c58ae80c8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:42.649547 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-633ba9bf-817b-4716-9c2a-f84c58ae80c8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:42.655561 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-633ba9bf-817b-4716-9c2a-f84c58ae80c8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:42.656174 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-633ba9bf-817b-4716-9c2a-f84c58ae80c8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:42.656624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-633ba9bf-817b-4716-9c2a-f84c58ae80c8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:42.657410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-633ba9bf-817b-4716-9c2a-f84c58ae80c8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:42.657915 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-633ba9bf-817b-4716-9c2a-f84c58ae80c8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:42.658386 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-633ba9bf-817b-4716-9c2a-f84c58ae80c8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:42.689822 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-633ba9bf-817b-4716-9c2a-f84c58ae80c8 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047652 Oct 06 11:20:42.690400 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 604/1200] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:20:42 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:20:43.703901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9fd7ed73-d883-4332-855f-24d7b3d93229 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:43.706185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9fd7ed73-d883-4332-855f-24d7b3d93229 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:43.712919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd7ed73-d883-4332-855f-24d7b3d93229 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:43.713407 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd7ed73-d883-4332-855f-24d7b3d93229 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:43.713849 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd7ed73-d883-4332-855f-24d7b3d93229 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:43.714555 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd7ed73-d883-4332-855f-24d7b3d93229 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:43.715012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd7ed73-d883-4332-855f-24d7b3d93229 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:43.715445 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd7ed73-d883-4332-855f-24d7b3d93229 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:43.745425 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9fd7ed73-d883-4332-855f-24d7b3d93229 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046715 Oct 06 11:20:43.745994 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 597/1201] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:20:43 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 11:20:43.810075 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ca683d6-04f3-4934-90da-83b950226f75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:43.810628 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ca683d6-04f3-4934-90da-83b950226f75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:43.817073 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ca683d6-04f3-4934-90da-83b950226f75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:43.817561 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ca683d6-04f3-4934-90da-83b950226f75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:43.818002 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ca683d6-04f3-4934-90da-83b950226f75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:43.818699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ca683d6-04f3-4934-90da-83b950226f75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:43.819157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ca683d6-04f3-4934-90da-83b950226f75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:43.819586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ca683d6-04f3-4934-90da-83b950226f75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:43.845407 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ca683d6-04f3-4934-90da-83b950226f75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:20:43.922834 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ca683d6-04f3-4934-90da-83b950226f75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 204 len: 0 microversion: 2.1 time: 0.116770 Oct 06 11:20:43.923646 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 605/1202] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:20:43 2022] DELETE /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:20:43.932302 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-00e1d889-db69-41e6-9020-b39964bf0fe0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:43.932928 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-00e1d889-db69-41e6-9020-b39964bf0fe0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:43.938766 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00e1d889-db69-41e6-9020-b39964bf0fe0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:43.939282 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00e1d889-db69-41e6-9020-b39964bf0fe0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:43.939724 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00e1d889-db69-41e6-9020-b39964bf0fe0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:43.940451 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00e1d889-db69-41e6-9020-b39964bf0fe0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:43.940909 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00e1d889-db69-41e6-9020-b39964bf0fe0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:43.941337 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00e1d889-db69-41e6-9020-b39964bf0fe0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:44.078140 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-00e1d889-db69-41e6-9020-b39964bf0fe0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:44.086405 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-00e1d889-db69-41e6-9020-b39964bf0fe0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1680 microversion: 2.1 time: 0.157423 Oct 06 11:20:44.087070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 598/1203] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:43 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:20:45.109986 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-56faccc1-5c08-4033-a45b-2b2f8894dded tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:45.110694 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-56faccc1-5c08-4033-a45b-2b2f8894dded tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:45.116849 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56faccc1-5c08-4033-a45b-2b2f8894dded tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:45.117610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56faccc1-5c08-4033-a45b-2b2f8894dded tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:45.118055 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56faccc1-5c08-4033-a45b-2b2f8894dded tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:45.118759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56faccc1-5c08-4033-a45b-2b2f8894dded tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:45.119221 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56faccc1-5c08-4033-a45b-2b2f8894dded tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:45.119677 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56faccc1-5c08-4033-a45b-2b2f8894dded tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:45.248268 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-56faccc1-5c08-4033-a45b-2b2f8894dded tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:45.255932 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-56faccc1-5c08-4033-a45b-2b2f8894dded tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1680 microversion: 2.1 time: 0.150213 Oct 06 11:20:45.256494 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 606/1204] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:45 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:20:46.279070 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4cf0a62e-22e3-402f-99d6-388a4339b718 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:46.279695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4cf0a62e-22e3-402f-99d6-388a4339b718 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:46.286188 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cf0a62e-22e3-402f-99d6-388a4339b718 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:46.286699 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cf0a62e-22e3-402f-99d6-388a4339b718 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:46.287136 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cf0a62e-22e3-402f-99d6-388a4339b718 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:46.287831 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cf0a62e-22e3-402f-99d6-388a4339b718 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:46.288363 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cf0a62e-22e3-402f-99d6-388a4339b718 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:46.288783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cf0a62e-22e3-402f-99d6-388a4339b718 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:46.419682 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4cf0a62e-22e3-402f-99d6-388a4339b718 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:46.427561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4cf0a62e-22e3-402f-99d6-388a4339b718 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1680 microversion: 2.1 time: 0.152588 Oct 06 11:20:46.428170 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 599/1205] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:46 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:20:47.076516 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-79de5391-d1be-43c8-a06c-0ebda7613575 req-99e1b54c-e7cd-4289-a87a-e8e08d0eff4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "605e2ba5-ae23-430e-a8a5-439650222ad4", "name": "network-vif-deleted", "tag": "818b712e-b370-45de-919c-0b00b646f201"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:20:47.088847 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-79de5391-d1be-43c8-a06c-0ebda7613575 req-99e1b54c-e7cd-4289-a87a-e8e08d0eff4f service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:47.089459 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-79de5391-d1be-43c8-a06c-0ebda7613575 req-99e1b54c-e7cd-4289-a87a-e8e08d0eff4f service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:47.089900 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-79de5391-d1be-43c8-a06c-0ebda7613575 req-99e1b54c-e7cd-4289-a87a-e8e08d0eff4f service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:47.105933 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-79de5391-d1be-43c8-a06c-0ebda7613575 req-99e1b54c-e7cd-4289-a87a-e8e08d0eff4f service nova] Creating event network-vif-deleted:818b712e-b370-45de-919c-0b00b646f201 for instance 605e2ba5-ae23-430e-a8a5-439650222ad4 on hv-cinder-86020 Oct 06 11:20:47.112420 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-79de5391-d1be-43c8-a06c-0ebda7613575 req-99e1b54c-e7cd-4289-a87a-e8e08d0eff4f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187141 Oct 06 11:20:47.113562 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 607/1206] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:20:47.451429 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:47.452083 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:47.458771 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:47.459260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:47.459695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:47.460613 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:47.461075 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:47.461505 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:47.500949 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:47.501440 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:47.501879 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:47.502332 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lazy-loading 'fault' on Instance uuid 605e2ba5-ae23-430e-a8a5-439650222ad4 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:20:47.546781 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:47.556198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-530dbea8-5e58-4f3d-9e46-8c978501680a tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 200 len: 1330 microversion: 2.1 time: 0.108462 Oct 06 11:20:47.557171 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 600/1207] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:47 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:20:48.581249 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:48.581975 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:48.588524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:48.589008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:48.589442 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:48.590134 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:48.590586 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:48.591015 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:48.605008 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 HTTP/1.1 Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:20:48.606596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:20:48.608310 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '605e2ba5-ae23-430e-a8a5-439650222ad4'} Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:20:48.609474 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:20:48.611127 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:20:48.612862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:20:48.612862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9019fbb7-8f08-4807-8dc5-2a1ac34ad92f tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 404 len: 111 microversion: 2.1 time: 0.030931 Oct 06 11:20:48.612862 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 608/1208] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:48 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:20:48.616586 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6b3b285-c28f-4d51-81fe-8b2d4740ad75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '.version_select at 0x7f92a6fa8ee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:48.635633 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6b3b285-c28f-4d51-81fe-8b2d4740ad75 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-572232762" status: 202 len: 0 microversion: 2.1 time: 0.022702 Oct 06 11:20:48.636229 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 601/1209] 10.222.0.52 () {58 vars in 1218 bytes} [Thu Oct 6 11:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-572232762 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:20:49.232684 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94f272b9-ce3a-4d42-a2ee-9fe8b6042f5c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: .version_select at 0x7f92a70ce820>, body: {"keypair": {"name": "tempest-keypair-1213001886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMW9PsKVFMYyRA0h3LDvZAKnYgmDyScArlOZveb3DhdEaQibG+6fcNec6eX8eGsJHYT72FZwIHpt3njv2mGC5nvmAqaOoHDp5zcUdAT1Kmew9pFbla79ZBpxPT6IMDupA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:20:49.247733 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-94f272b9-ce3a-4d42-a2ee-9fe8b6042f5c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:20:49.251528 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-94f272b9-ce3a-4d42-a2ee-9fe8b6042f5c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for user 4ad5a3ee5ab545e2893d4f6365f8f939 and project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:20:49.273380 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94f272b9-ce3a-4d42-a2ee-9fe8b6042f5c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044806 Oct 06 11:20:49.273967 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 609/1210] 10.222.0.52 () {60 vars in 1159 bytes} [Thu Oct 6 11:20:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:20:50.505803 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1061919657", "imageRef": "22b1ec50-8fd1-4598-a86b-3c7ffe7be75f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d576013-5c41-470a-82ec-fbb07f6bd986"}], "security_groups": [{"name": "tempest-securitygroup--1863460627"}], "key_name": "tempest-keypair-1213001886", "user_data": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:20:50.608921 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] validate_networks() for [('8d576013-5c41-470a-82ec-fbb07f6bd986', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:20:51.064964 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:20:51.065392 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:20:51.065872 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:20:51.066285 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:20:51.066730 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:20:51.076915 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:51.077403 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:51.077845 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:51.078588 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:51.079046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:51.079482 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:51.096436 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:20:51.100328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Getting quotas for user 4ad5a3ee5ab545e2893d4f6365f8f939 and project 5d69675576dc4c7fa5cede0f99db8e32. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:20:51.111089 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:20:51.113420 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22b1ec50-8fd1-4598-a86b-3c7ffe7be75f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:20:51.163123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-02e65d23-5041-47ea-8d7f-5bde88d220eb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.661822 Oct 06 11:20:51.163791 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 602/1211] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:20:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:20:51.175326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-771bb73a-90f9-4aeb-b059-01954eaf1762 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:51.175974 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-771bb73a-90f9-4aeb-b059-01954eaf1762 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:51.232057 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-771bb73a-90f9-4aeb-b059-01954eaf1762 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:51.238754 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-771bb73a-90f9-4aeb-b059-01954eaf1762 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1242 microversion: 2.1 time: 0.067836 Oct 06 11:20:51.239317 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 610/1212] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:51 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:20:52.262568 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b68c613-f297-495b-9a11-ec17c486bc84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:52.263305 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b68c613-f297-495b-9a11-ec17c486bc84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:52.269839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b68c613-f297-495b-9a11-ec17c486bc84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:52.270321 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b68c613-f297-495b-9a11-ec17c486bc84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:52.270753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b68c613-f297-495b-9a11-ec17c486bc84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:52.271446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b68c613-f297-495b-9a11-ec17c486bc84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:52.272170 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b68c613-f297-495b-9a11-ec17c486bc84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:52.272596 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b68c613-f297-495b-9a11-ec17c486bc84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:52.338084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b68c613-f297-495b-9a11-ec17c486bc84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:52.347001 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b68c613-f297-495b-9a11-ec17c486bc84 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1294 microversion: 2.1 time: 0.088732 Oct 06 11:20:52.347808 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 603/1213] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:52 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:20:53.370925 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd528692-d4dc-4b2b-bcbc-b48de5e3c720 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:53.371548 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd528692-d4dc-4b2b-bcbc-b48de5e3c720 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:53.378106 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd528692-d4dc-4b2b-bcbc-b48de5e3c720 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:53.378602 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd528692-d4dc-4b2b-bcbc-b48de5e3c720 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:53.379137 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd528692-d4dc-4b2b-bcbc-b48de5e3c720 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:53.379907 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd528692-d4dc-4b2b-bcbc-b48de5e3c720 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:53.380589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd528692-d4dc-4b2b-bcbc-b48de5e3c720 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:53.381014 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd528692-d4dc-4b2b-bcbc-b48de5e3c720 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:53.866941 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd528692-d4dc-4b2b-bcbc-b48de5e3c720 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:53.875208 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd528692-d4dc-4b2b-bcbc-b48de5e3c720 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1368 microversion: 2.1 time: 0.508585 Oct 06 11:20:53.881457 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 611/1214] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:53 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1368 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:20:54.180636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7ae00c1d-bea7-4da4-9474-425b502b068f req-bad1acd0-fa77-473c-a939-40bb09147a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd61e55-b590-41ff-ba2c-d87038bae7cc", "tag": "9f625844-0348-4f62-9cc9-f14396f34f9d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:20:54.192371 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7ae00c1d-bea7-4da4-9474-425b502b068f req-bad1acd0-fa77-473c-a939-40bb09147a1a service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:54.192947 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7ae00c1d-bea7-4da4-9474-425b502b068f req-bad1acd0-fa77-473c-a939-40bb09147a1a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:54.193422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7ae00c1d-bea7-4da4-9474-425b502b068f req-bad1acd0-fa77-473c-a939-40bb09147a1a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:54.205836 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7ae00c1d-bea7-4da4-9474-425b502b068f req-bad1acd0-fa77-473c-a939-40bb09147a1a service nova] Creating event network-changed:9f625844-0348-4f62-9cc9-f14396f34f9d for instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc on hv-cinder-86020 Oct 06 11:20:54.210899 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7ae00c1d-bea7-4da4-9474-425b502b068f req-bad1acd0-fa77-473c-a939-40bb09147a1a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034417 Oct 06 11:20:54.211502 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 604/1215] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:20:54.898769 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1035e6b-0710-4c7a-a4c3-194489274659 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:54.899333 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1035e6b-0710-4c7a-a4c3-194489274659 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:54.908942 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1035e6b-0710-4c7a-a4c3-194489274659 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:54.909429 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1035e6b-0710-4c7a-a4c3-194489274659 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:54.909870 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1035e6b-0710-4c7a-a4c3-194489274659 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:54.910566 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1035e6b-0710-4c7a-a4c3-194489274659 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:54.911022 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1035e6b-0710-4c7a-a4c3-194489274659 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:54.911449 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1035e6b-0710-4c7a-a4c3-194489274659 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:55.039251 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1035e6b-0710-4c7a-a4c3-194489274659 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:55.047139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1035e6b-0710-4c7a-a4c3-194489274659 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1368 microversion: 2.1 time: 0.152540 Oct 06 11:20:55.047702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 612/1216] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:54 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:20:56.070651 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93cd32b3-28d6-4642-b2fb-d255e63f8cc5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:56.071350 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-93cd32b3-28d6-4642-b2fb-d255e63f8cc5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:56.078640 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93cd32b3-28d6-4642-b2fb-d255e63f8cc5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:56.079120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93cd32b3-28d6-4642-b2fb-d255e63f8cc5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:56.079550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93cd32b3-28d6-4642-b2fb-d255e63f8cc5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:56.080269 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93cd32b3-28d6-4642-b2fb-d255e63f8cc5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:56.080719 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93cd32b3-28d6-4642-b2fb-d255e63f8cc5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:56.081141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93cd32b3-28d6-4642-b2fb-d255e63f8cc5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:56.211318 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-93cd32b3-28d6-4642-b2fb-d255e63f8cc5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:56.219573 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-93cd32b3-28d6-4642-b2fb-d255e63f8cc5 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1368 microversion: 2.1 time: 0.153118 Oct 06 11:20:56.220175 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 605/1217] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:56 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:20:57.242477 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de7c79fc-4b8d-4d12-b77c-d6c080621209 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:57.243019 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-de7c79fc-4b8d-4d12-b77c-d6c080621209 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:57.249939 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de7c79fc-4b8d-4d12-b77c-d6c080621209 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:57.250420 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de7c79fc-4b8d-4d12-b77c-d6c080621209 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:57.250854 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de7c79fc-4b8d-4d12-b77c-d6c080621209 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:57.251541 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de7c79fc-4b8d-4d12-b77c-d6c080621209 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:57.252020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de7c79fc-4b8d-4d12-b77c-d6c080621209 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:57.252445 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de7c79fc-4b8d-4d12-b77c-d6c080621209 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:57.379496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-de7c79fc-4b8d-4d12-b77c-d6c080621209 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:57.387111 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-de7c79fc-4b8d-4d12-b77c-d6c080621209 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1368 microversion: 2.1 time: 0.148535 Oct 06 11:20:57.387676 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 613/1218] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:57 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:20:58.410260 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d686557d-e30f-4ea9-8135-0256828c75bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:58.410883 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d686557d-e30f-4ea9-8135-0256828c75bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:58.417497 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d686557d-e30f-4ea9-8135-0256828c75bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:58.417981 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d686557d-e30f-4ea9-8135-0256828c75bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:58.418422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d686557d-e30f-4ea9-8135-0256828c75bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:58.419116 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d686557d-e30f-4ea9-8135-0256828c75bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:58.419570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d686557d-e30f-4ea9-8135-0256828c75bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:58.420034 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d686557d-e30f-4ea9-8135-0256828c75bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:58.546861 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-d686557d-e30f-4ea9-8135-0256828c75bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:58.554430 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d686557d-e30f-4ea9-8135-0256828c75bc tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1368 microversion: 2.1 time: 0.148007 Oct 06 11:20:58.554998 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 606/1219] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:58 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:20:59.577441 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a81a7e77-076a-488b-a52d-0ea196ec3917 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:20:59.578067 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a81a7e77-076a-488b-a52d-0ea196ec3917 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:20:59.584688 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a81a7e77-076a-488b-a52d-0ea196ec3917 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:59.585175 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a81a7e77-076a-488b-a52d-0ea196ec3917 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:59.585619 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a81a7e77-076a-488b-a52d-0ea196ec3917 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:59.586324 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a81a7e77-076a-488b-a52d-0ea196ec3917 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:20:59.586784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a81a7e77-076a-488b-a52d-0ea196ec3917 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:20:59.587216 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a81a7e77-076a-488b-a52d-0ea196ec3917 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:20:59.717570 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a81a7e77-076a-488b-a52d-0ea196ec3917 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:20:59.725139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a81a7e77-076a-488b-a52d-0ea196ec3917 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1368 microversion: 2.1 time: 0.152257 Oct 06 11:20:59.725703 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 614/1220] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:20:59 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:00.171462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-32065e16-b854-4a88-964c-5077092148f0 req-2108a79d-c7db-4333-aa12-b665828a9f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd61e55-b590-41ff-ba2c-d87038bae7cc", "name": "network-vif-plugged", "status": "completed", "tag": "9f625844-0348-4f62-9cc9-f14396f34f9d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:21:00.181926 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-32065e16-b854-4a88-964c-5077092148f0 req-2108a79d-c7db-4333-aa12-b665828a9f6b service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:00.183666 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-32065e16-b854-4a88-964c-5077092148f0 req-2108a79d-c7db-4333-aa12-b665828a9f6b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:00.184206 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-32065e16-b854-4a88-964c-5077092148f0 req-2108a79d-c7db-4333-aa12-b665828a9f6b service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:00.197854 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-32065e16-b854-4a88-964c-5077092148f0 req-2108a79d-c7db-4333-aa12-b665828a9f6b service nova] Creating event network-vif-plugged:9f625844-0348-4f62-9cc9-f14396f34f9d for instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc on hv-cinder-86020 Oct 06 11:21:00.203388 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-32065e16-b854-4a88-964c-5077092148f0 req-2108a79d-c7db-4333-aa12-b665828a9f6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036032 Oct 06 11:21:00.204682 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 607/1221] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:21:00.748536 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13f06165-9243-47fb-b60a-ec9cd7013e9d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:00.749148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13f06165-9243-47fb-b60a-ec9cd7013e9d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:00.756802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13f06165-9243-47fb-b60a-ec9cd7013e9d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:00.757293 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13f06165-9243-47fb-b60a-ec9cd7013e9d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:00.757734 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13f06165-9243-47fb-b60a-ec9cd7013e9d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:00.758430 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13f06165-9243-47fb-b60a-ec9cd7013e9d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:00.758885 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13f06165-9243-47fb-b60a-ec9cd7013e9d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:00.759313 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13f06165-9243-47fb-b60a-ec9cd7013e9d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:00.887606 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-13f06165-9243-47fb-b60a-ec9cd7013e9d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:00.895176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13f06165-9243-47fb-b60a-ec9cd7013e9d tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1368 microversion: 2.1 time: 0.151581 Oct 06 11:21:00.895743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 615/1222] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:00 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:01.919118 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da9247b8-1a11-4e03-b4d6-1df322497eff tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:01.919725 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da9247b8-1a11-4e03-b4d6-1df322497eff tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:01.921655 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:01.922302 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:01.928857 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da9247b8-1a11-4e03-b4d6-1df322497eff tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:01.929332 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da9247b8-1a11-4e03-b4d6-1df322497eff tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:01.929763 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da9247b8-1a11-4e03-b4d6-1df322497eff tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:01.930450 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da9247b8-1a11-4e03-b4d6-1df322497eff tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:01.930895 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da9247b8-1a11-4e03-b4d6-1df322497eff tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:01.931308 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da9247b8-1a11-4e03-b4d6-1df322497eff tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:02.063109 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-da9247b8-1a11-4e03-b4d6-1df322497eff tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:02.070576 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da9247b8-1a11-4e03-b4d6-1df322497eff tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1368 microversion: 2.1 time: 0.155771 Oct 06 11:21:02.071140 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 608/1223] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:01 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:03.093904 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6289c0e7-e22e-4ff8-bad2-0e050386aa88 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:03.094530 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6289c0e7-e22e-4ff8-bad2-0e050386aa88 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:03.096507 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:03.097693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:03.105397 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6289c0e7-e22e-4ff8-bad2-0e050386aa88 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:03.106011 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6289c0e7-e22e-4ff8-bad2-0e050386aa88 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:03.106456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6289c0e7-e22e-4ff8-bad2-0e050386aa88 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:03.107162 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6289c0e7-e22e-4ff8-bad2-0e050386aa88 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:03.107620 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6289c0e7-e22e-4ff8-bad2-0e050386aa88 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:03.108076 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6289c0e7-e22e-4ff8-bad2-0e050386aa88 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:03.111088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:03.241568 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6289c0e7-e22e-4ff8-bad2-0e050386aa88 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:03.249379 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6289c0e7-e22e-4ff8-bad2-0e050386aa88 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1558 microversion: 2.1 time: 0.159265 Oct 06 11:21:03.249946 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 616/1224] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:03 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:03.271983 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-732da3fd-da22-41cb-9af5-fbfc681ce14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:03.272503 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-732da3fd-da22-41cb-9af5-fbfc681ce14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:03.279286 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-732da3fd-da22-41cb-9af5-fbfc681ce14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:03.279810 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-732da3fd-da22-41cb-9af5-fbfc681ce14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:03.280271 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-732da3fd-da22-41cb-9af5-fbfc681ce14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:03.280956 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-732da3fd-da22-41cb-9af5-fbfc681ce14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:03.281405 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-732da3fd-da22-41cb-9af5-fbfc681ce14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:03.281824 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-732da3fd-da22-41cb-9af5-fbfc681ce14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:03.360945 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-732da3fd-da22-41cb-9af5-fbfc681ce14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093118 Oct 06 11:21:03.361544 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 609/1225] 10.222.0.52 () {58 vars in 1275 bytes} [Thu Oct 6 11:21:03 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:21:04.277409 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0fa4f544-3202-411a-b602-a0cf6594afe6 req-ecd8da72-e7a8-4518-9480-1ca47463116a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd61e55-b590-41ff-ba2c-d87038bae7cc", "tag": "9f625844-0348-4f62-9cc9-f14396f34f9d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:21:04.287346 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0fa4f544-3202-411a-b602-a0cf6594afe6 req-ecd8da72-e7a8-4518-9480-1ca47463116a service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:04.287829 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0fa4f544-3202-411a-b602-a0cf6594afe6 req-ecd8da72-e7a8-4518-9480-1ca47463116a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:04.288284 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0fa4f544-3202-411a-b602-a0cf6594afe6 req-ecd8da72-e7a8-4518-9480-1ca47463116a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:04.299298 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0fa4f544-3202-411a-b602-a0cf6594afe6 req-ecd8da72-e7a8-4518-9480-1ca47463116a service nova] Creating event network-changed:9f625844-0348-4f62-9cc9-f14396f34f9d for instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc on hv-cinder-86020 Oct 06 11:21:04.304463 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0fa4f544-3202-411a-b602-a0cf6594afe6 req-ecd8da72-e7a8-4518-9480-1ca47463116a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031345 Oct 06 11:21:04.305068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 617/1226] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:21:39.944388 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:39.945137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:39.949124 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-523976166", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1768988469", "security_groups": [{"name": "tempest-secgroup-smoke-516401855"}], "block_device_mapping_v2": [{"uuid": "bd892d27-f917-49f2-aecc-c87df25730bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4328977c-615f-4aaa-a450-a9014d5b4970"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:21:40.066757 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] validate_networks() for [('4328977c-615f-4aaa-a450-a9014d5b4970', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 11:21:40.436707 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 11:21:40.437134 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 11:21:40.437613 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 11:21:40.438035 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 11:21:40.439026 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 11:21:40.447660 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:40.448183 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:40.448626 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:40.449354 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:40.449807 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:40.450234 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:40.466922 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Getting quotas for project 0934343645484d01b9b48a40bbf0b671. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 11:21:40.471789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.quota [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Getting quotas for user acf06fe641e94b5b91145ed230ac7213 and project 0934343645484d01b9b48a40bbf0b671. Resources: {'instances', 'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 11:21:40.528893 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 11:21:40.531048 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd892d27-f917-49f2-aecc-c87df25730bb',volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 11:21:40.656504 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aae5cc2a-7acf-4d25-8dad-85c72b28ce57 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.713481 Oct 06 11:21:40.657814 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 610/1227] 10.222.0.52 () {60 vars in 1147 bytes} [Thu Oct 6 11:21:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 11:21:40.666827 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:40.667556 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:40.671493 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3aff4d7a-08fa-4c69-9b90-a5580007b35d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:40.672233 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3aff4d7a-08fa-4c69-9b90-a5580007b35d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:40.731524 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3aff4d7a-08fa-4c69-9b90-a5580007b35d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:40.738716 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3aff4d7a-08fa-4c69-9b90-a5580007b35d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1094 microversion: 2.1 time: 0.073364 Oct 06 11:21:40.739292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 618/1228] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:40 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:41.762437 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1100f433-6d8d-40c7-9e7f-51d516c40f5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:41.763677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1100f433-6d8d-40c7-9e7f-51d516c40f5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:41.770825 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1100f433-6d8d-40c7-9e7f-51d516c40f5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:41.771491 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1100f433-6d8d-40c7-9e7f-51d516c40f5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:41.772313 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1100f433-6d8d-40c7-9e7f-51d516c40f5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:41.773245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1100f433-6d8d-40c7-9e7f-51d516c40f5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:41.773866 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1100f433-6d8d-40c7-9e7f-51d516c40f5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:41.774291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1100f433-6d8d-40c7-9e7f-51d516c40f5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:41.839647 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-1100f433-6d8d-40c7-9e7f-51d516c40f5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:41.848668 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1100f433-6d8d-40c7-9e7f-51d516c40f5d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1200 microversion: 2.1 time: 0.090820 Oct 06 11:21:41.849241 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 611/1229] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:41 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:42.872642 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfd2007a-ff11-49a5-b628-eeefd8bc802c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:42.873496 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cfd2007a-ff11-49a5-b628-eeefd8bc802c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:42.881610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfd2007a-ff11-49a5-b628-eeefd8bc802c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:42.882187 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfd2007a-ff11-49a5-b628-eeefd8bc802c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:42.882693 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfd2007a-ff11-49a5-b628-eeefd8bc802c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:42.883594 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfd2007a-ff11-49a5-b628-eeefd8bc802c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:42.884153 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfd2007a-ff11-49a5-b628-eeefd8bc802c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:42.884663 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfd2007a-ff11-49a5-b628-eeefd8bc802c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:43.094932 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cfd2007a-ff11-49a5-b628-eeefd8bc802c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:43.102610 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cfd2007a-ff11-49a5-b628-eeefd8bc802c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.234088 Oct 06 11:21:43.103177 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 619/1230] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:42 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:43.245941 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-75922a4c-e5c3-4c5f-89f7-5ce69778552f req-b57ec4cf-b12e-4635-8cc8-af230bad5335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abc00d92-0c52-4d38-a0df-5b07f32c182b", "tag": "c4043237-0c79-48b2-8d04-310009d98d00"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:21:43.256530 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-75922a4c-e5c3-4c5f-89f7-5ce69778552f req-b57ec4cf-b12e-4635-8cc8-af230bad5335 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:43.257038 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-75922a4c-e5c3-4c5f-89f7-5ce69778552f req-b57ec4cf-b12e-4635-8cc8-af230bad5335 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:43.257491 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-75922a4c-e5c3-4c5f-89f7-5ce69778552f req-b57ec4cf-b12e-4635-8cc8-af230bad5335 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:43.268564 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-75922a4c-e5c3-4c5f-89f7-5ce69778552f req-b57ec4cf-b12e-4635-8cc8-af230bad5335 service nova] Creating event network-changed:c4043237-0c79-48b2-8d04-310009d98d00 for instance abc00d92-0c52-4d38-a0df-5b07f32c182b on hv-cinder-86020 Oct 06 11:21:43.274126 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-75922a4c-e5c3-4c5f-89f7-5ce69778552f req-b57ec4cf-b12e-4635-8cc8-af230bad5335 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031745 Oct 06 11:21:43.274727 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 612/1231] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 11:21:44.126307 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-456d8d65-4ae3-4b4e-a23d-dd2e88ae3871 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:44.127086 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-456d8d65-4ae3-4b4e-a23d-dd2e88ae3871 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:44.133645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-456d8d65-4ae3-4b4e-a23d-dd2e88ae3871 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:44.134134 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-456d8d65-4ae3-4b4e-a23d-dd2e88ae3871 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:44.134580 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-456d8d65-4ae3-4b4e-a23d-dd2e88ae3871 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:44.135293 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-456d8d65-4ae3-4b4e-a23d-dd2e88ae3871 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:44.135769 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-456d8d65-4ae3-4b4e-a23d-dd2e88ae3871 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:44.136264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-456d8d65-4ae3-4b4e-a23d-dd2e88ae3871 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:44.269525 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-456d8d65-4ae3-4b4e-a23d-dd2e88ae3871 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:44.277626 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-456d8d65-4ae3-4b4e-a23d-dd2e88ae3871 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.155637 Oct 06 11:21:44.278234 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 620/1232] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:44 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:45.301544 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e346ff9-4de5-422d-abbe-6c6f21e7424b tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:45.302265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e346ff9-4de5-422d-abbe-6c6f21e7424b tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:45.308256 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e346ff9-4de5-422d-abbe-6c6f21e7424b tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:45.308738 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e346ff9-4de5-422d-abbe-6c6f21e7424b tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:45.309168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e346ff9-4de5-422d-abbe-6c6f21e7424b tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:45.309858 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e346ff9-4de5-422d-abbe-6c6f21e7424b tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:45.310302 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e346ff9-4de5-422d-abbe-6c6f21e7424b tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:45.310720 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e346ff9-4de5-422d-abbe-6c6f21e7424b tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:45.441816 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e346ff9-4de5-422d-abbe-6c6f21e7424b tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:45.449553 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e346ff9-4de5-422d-abbe-6c6f21e7424b tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.152951 Oct 06 11:21:45.450120 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 613/1233] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:45 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:46.473495 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa9e44ae-da56-464f-8bc8-337521da7163 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:46.474104 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa9e44ae-da56-464f-8bc8-337521da7163 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:46.480058 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9e44ae-da56-464f-8bc8-337521da7163 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:46.480546 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9e44ae-da56-464f-8bc8-337521da7163 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:46.480977 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9e44ae-da56-464f-8bc8-337521da7163 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:46.481672 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9e44ae-da56-464f-8bc8-337521da7163 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:46.482124 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9e44ae-da56-464f-8bc8-337521da7163 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:46.482549 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9e44ae-da56-464f-8bc8-337521da7163 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:46.611538 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa9e44ae-da56-464f-8bc8-337521da7163 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:46.619264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa9e44ae-da56-464f-8bc8-337521da7163 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.150428 Oct 06 11:21:46.619866 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 621/1234] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:46 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:47.641887 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42d5d1c1-65b1-4d01-a250-71f89f014686 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:47.642570 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-42d5d1c1-65b1-4d01-a250-71f89f014686 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:47.649289 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d5d1c1-65b1-4d01-a250-71f89f014686 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:47.649768 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d5d1c1-65b1-4d01-a250-71f89f014686 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:47.650270 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d5d1c1-65b1-4d01-a250-71f89f014686 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:47.650956 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d5d1c1-65b1-4d01-a250-71f89f014686 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:47.651406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d5d1c1-65b1-4d01-a250-71f89f014686 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:47.651827 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d5d1c1-65b1-4d01-a250-71f89f014686 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:47.791242 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-42d5d1c1-65b1-4d01-a250-71f89f014686 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:47.799687 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-42d5d1c1-65b1-4d01-a250-71f89f014686 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.161871 Oct 06 11:21:47.800299 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 614/1235] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:47 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:48.823019 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-43f48cd6-3251-408a-a151-f702ce17f618 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:48.823636 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-43f48cd6-3251-408a-a151-f702ce17f618 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:48.831283 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f48cd6-3251-408a-a151-f702ce17f618 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:48.831773 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f48cd6-3251-408a-a151-f702ce17f618 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:48.832236 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f48cd6-3251-408a-a151-f702ce17f618 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:48.832933 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f48cd6-3251-408a-a151-f702ce17f618 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:48.833388 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f48cd6-3251-408a-a151-f702ce17f618 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:48.833816 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f48cd6-3251-408a-a151-f702ce17f618 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:48.962318 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-43f48cd6-3251-408a-a151-f702ce17f618 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:48.969853 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-43f48cd6-3251-408a-a151-f702ce17f618 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.150658 Oct 06 11:21:48.970551 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 622/1236] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:48 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:49.992838 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66666125-20ef-4ed4-a995-a5c402b9f30d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:49.993447 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66666125-20ef-4ed4-a995-a5c402b9f30d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:49.999380 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66666125-20ef-4ed4-a995-a5c402b9f30d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:49.999884 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66666125-20ef-4ed4-a995-a5c402b9f30d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:50.000324 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66666125-20ef-4ed4-a995-a5c402b9f30d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:50.001061 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66666125-20ef-4ed4-a995-a5c402b9f30d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:50.001807 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66666125-20ef-4ed4-a995-a5c402b9f30d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:50.002244 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66666125-20ef-4ed4-a995-a5c402b9f30d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:50.134486 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-66666125-20ef-4ed4-a995-a5c402b9f30d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:50.142852 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66666125-20ef-4ed4-a995-a5c402b9f30d tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.153224 Oct 06 11:21:50.143431 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 615/1237] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:49 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:51.173911 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-720f447a-cc7a-42bf-ad12-2b41e24c3621 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:51.174458 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-720f447a-cc7a-42bf-ad12-2b41e24c3621 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:51.176819 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:51.182082 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720f447a-cc7a-42bf-ad12-2b41e24c3621 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:51.182567 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720f447a-cc7a-42bf-ad12-2b41e24c3621 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:51.183007 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720f447a-cc7a-42bf-ad12-2b41e24c3621 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:51.183703 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720f447a-cc7a-42bf-ad12-2b41e24c3621 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:51.184292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720f447a-cc7a-42bf-ad12-2b41e24c3621 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:51.184724 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-720f447a-cc7a-42bf-ad12-2b41e24c3621 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:51.322589 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-720f447a-cc7a-42bf-ad12-2b41e24c3621 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:51.331751 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-720f447a-cc7a-42bf-ad12-2b41e24c3621 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.162160 Oct 06 11:21:51.332347 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 623/1238] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:51 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:52.354542 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f261bfcd-0555-4826-ae63-419d95fa5c3e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:52.355123 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f261bfcd-0555-4826-ae63-419d95fa5c3e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:52.357034 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:52.357697 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:52.365267 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f261bfcd-0555-4826-ae63-419d95fa5c3e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:52.365760 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f261bfcd-0555-4826-ae63-419d95fa5c3e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:52.366200 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f261bfcd-0555-4826-ae63-419d95fa5c3e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:52.366903 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f261bfcd-0555-4826-ae63-419d95fa5c3e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:52.367356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f261bfcd-0555-4826-ae63-419d95fa5c3e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:52.367782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f261bfcd-0555-4826-ae63-419d95fa5c3e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:52.503891 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-f261bfcd-0555-4826-ae63-419d95fa5c3e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:52.511958 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f261bfcd-0555-4826-ae63-419d95fa5c3e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.161235 Oct 06 11:21:52.512547 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 616/1239] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:52 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:53.536645 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-56b2d06a-045c-4e1b-a1c9-268d37430b17 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:53.537296 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-56b2d06a-045c-4e1b-a1c9-268d37430b17 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:53.543636 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56b2d06a-045c-4e1b-a1c9-268d37430b17 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:53.544163 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56b2d06a-045c-4e1b-a1c9-268d37430b17 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:53.544608 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56b2d06a-045c-4e1b-a1c9-268d37430b17 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:53.545303 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56b2d06a-045c-4e1b-a1c9-268d37430b17 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:53.545753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56b2d06a-045c-4e1b-a1c9-268d37430b17 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:53.546185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56b2d06a-045c-4e1b-a1c9-268d37430b17 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:53.673631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-56b2d06a-045c-4e1b-a1c9-268d37430b17 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:53.681784 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-56b2d06a-045c-4e1b-a1c9-268d37430b17 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.149261 Oct 06 11:21:53.682354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 624/1240] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:53 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:54.554221 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-12f35b8d-9387-40e8-8a07-0131c618f155 req-cb857943-4295-4af2-b702-a0b214aa6609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc00d92-0c52-4d38-a0df-5b07f32c182b", "name": "network-vif-plugged", "status": "completed", "tag": "c4043237-0c79-48b2-8d04-310009d98d00"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:21:54.563603 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-12f35b8d-9387-40e8-8a07-0131c618f155 req-cb857943-4295-4af2-b702-a0b214aa6609 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:54.564107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-12f35b8d-9387-40e8-8a07-0131c618f155 req-cb857943-4295-4af2-b702-a0b214aa6609 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:54.564535 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-12f35b8d-9387-40e8-8a07-0131c618f155 req-cb857943-4295-4af2-b702-a0b214aa6609 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:54.576302 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-12f35b8d-9387-40e8-8a07-0131c618f155 req-cb857943-4295-4af2-b702-a0b214aa6609 service nova] Creating event network-vif-plugged:c4043237-0c79-48b2-8d04-310009d98d00 for instance abc00d92-0c52-4d38-a0df-5b07f32c182b on hv-cinder-86020 Oct 06 11:21:54.582001 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-12f35b8d-9387-40e8-8a07-0131c618f155 req-cb857943-4295-4af2-b702-a0b214aa6609 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095027 Oct 06 11:21:54.582508 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 617/1241] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:21:54.705199 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13af9c1d-4a79-4543-be36-4fbcdf63ac27 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:54.705823 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13af9c1d-4a79-4543-be36-4fbcdf63ac27 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:54.712942 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13af9c1d-4a79-4543-be36-4fbcdf63ac27 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:54.713445 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13af9c1d-4a79-4543-be36-4fbcdf63ac27 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:54.713893 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13af9c1d-4a79-4543-be36-4fbcdf63ac27 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:54.714604 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13af9c1d-4a79-4543-be36-4fbcdf63ac27 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:54.715085 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13af9c1d-4a79-4543-be36-4fbcdf63ac27 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:54.715495 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13af9c1d-4a79-4543-be36-4fbcdf63ac27 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:54.885458 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-13af9c1d-4a79-4543-be36-4fbcdf63ac27 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:54.893352 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13af9c1d-4a79-4543-be36-4fbcdf63ac27 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.191998 Oct 06 11:21:54.894479 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 625/1242] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:54 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:55.917116 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b1adfab6-5f84-4a8d-a4d4-b09a81db75b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:55.917764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b1adfab6-5f84-4a8d-a4d4-b09a81db75b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:55.923865 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1adfab6-5f84-4a8d-a4d4-b09a81db75b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:55.924370 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1adfab6-5f84-4a8d-a4d4-b09a81db75b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:55.924802 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1adfab6-5f84-4a8d-a4d4-b09a81db75b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:55.925483 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1adfab6-5f84-4a8d-a4d4-b09a81db75b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:55.925930 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1adfab6-5f84-4a8d-a4d4-b09a81db75b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:55.926918 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1adfab6-5f84-4a8d-a4d4-b09a81db75b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:56.055559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1adfab6-5f84-4a8d-a4d4-b09a81db75b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:56.063112 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b1adfab6-5f84-4a8d-a4d4-b09a81db75b0 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1265 microversion: 2.1 time: 0.150858 Oct 06 11:21:56.063676 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 618/1243] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:55 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:57.086121 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c641be1-eae6-4c3f-a76b-fdb385768424 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:57.086721 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c641be1-eae6-4c3f-a76b-fdb385768424 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:57.093161 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c641be1-eae6-4c3f-a76b-fdb385768424 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:57.093643 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c641be1-eae6-4c3f-a76b-fdb385768424 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:57.094077 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c641be1-eae6-4c3f-a76b-fdb385768424 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:57.094765 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c641be1-eae6-4c3f-a76b-fdb385768424 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:57.095215 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c641be1-eae6-4c3f-a76b-fdb385768424 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:57.095637 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c641be1-eae6-4c3f-a76b-fdb385768424 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:57.230902 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c641be1-eae6-4c3f-a76b-fdb385768424 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:57.238594 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c641be1-eae6-4c3f-a76b-fdb385768424 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1453 microversion: 2.1 time: 0.156427 Oct 06 11:21:57.239768 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 626/1244] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:57 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:57.261607 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73bd295d-190a-4f55-bfb2-ac2f45e25969 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:21:57.262216 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-73bd295d-190a-4f55-bfb2-ac2f45e25969 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:21:57.268545 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73bd295d-190a-4f55-bfb2-ac2f45e25969 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:57.269037 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73bd295d-190a-4f55-bfb2-ac2f45e25969 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:57.269462 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73bd295d-190a-4f55-bfb2-ac2f45e25969 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:57.270239 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73bd295d-190a-4f55-bfb2-ac2f45e25969 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:57.270785 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73bd295d-190a-4f55-bfb2-ac2f45e25969 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:57.271071 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73bd295d-190a-4f55-bfb2-ac2f45e25969 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:57.401244 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-73bd295d-190a-4f55-bfb2-ac2f45e25969 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:21:57.408957 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-73bd295d-190a-4f55-bfb2-ac2f45e25969 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1453 microversion: 2.1 time: 0.151183 Oct 06 11:21:57.409517 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 619/1245] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:21:57 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:21:59.339286 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d11d3937-d9bb-4dcf-9c7c-571f47887620 req-064ea0c5-9ee8-4ab3-ae83-714ed078714a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abc00d92-0c52-4d38-a0df-5b07f32c182b", "tag": "c4043237-0c79-48b2-8d04-310009d98d00"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:21:59.349349 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d11d3937-d9bb-4dcf-9c7c-571f47887620 req-064ea0c5-9ee8-4ab3-ae83-714ed078714a service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:21:59.349840 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d11d3937-d9bb-4dcf-9c7c-571f47887620 req-064ea0c5-9ee8-4ab3-ae83-714ed078714a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:21:59.350280 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d11d3937-d9bb-4dcf-9c7c-571f47887620 req-064ea0c5-9ee8-4ab3-ae83-714ed078714a service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:21:59.361917 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d11d3937-d9bb-4dcf-9c7c-571f47887620 req-064ea0c5-9ee8-4ab3-ae83-714ed078714a service nova] Creating event network-changed:c4043237-0c79-48b2-8d04-310009d98d00 for instance abc00d92-0c52-4d38-a0df-5b07f32c182b on hv-cinder-86020 Oct 06 11:21:59.367777 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d11d3937-d9bb-4dcf-9c7c-571f47887620 req-064ea0c5-9ee8-4ab3-ae83-714ed078714a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032244 Oct 06 11:21:59.368761 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 627/1246] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:22.666152 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-305772f1-db3e-45f6-81e0-66fd326b6110 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:22.666745 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-305772f1-db3e-45f6-81e0-66fd326b6110 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:22.668885 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:22:22.669536 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=48 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:22:22.677014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-305772f1-db3e-45f6-81e0-66fd326b6110 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:22.677496 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-305772f1-db3e-45f6-81e0-66fd326b6110 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:22.677926 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-305772f1-db3e-45f6-81e0-66fd326b6110 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:22.678611 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-305772f1-db3e-45f6-81e0-66fd326b6110 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:22.679060 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-305772f1-db3e-45f6-81e0-66fd326b6110 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:22.679480 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-305772f1-db3e-45f6-81e0-66fd326b6110 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:22.702382 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-305772f1-db3e-45f6-81e0-66fd326b6110 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/ips" status: 200 len: 148 microversion: 2.1 time: 0.040222 Oct 06 11:22:22.702941 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 620/1247] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Oct 6 11:22:22 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:24.034023 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=22 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:22:24.034753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=50 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:22:24.036732 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 11:22:24.036888 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Thu Oct 6 11:22:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-volume_attachments (ip 10.222.0.52) !!! Oct 06 11:22:24.041590 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3860e0d4-19fc-4b54-a518-83df71e0b579 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e031a32e-9167-4ec1-b1e4-bf476b6dbd4c"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:22:24.044011 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3860e0d4-19fc-4b54-a518-83df71e0b579 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:24.053244 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3860e0d4-19fc-4b54-a518-83df71e0b579 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:24.053729 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3860e0d4-19fc-4b54-a518-83df71e0b579 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:24.054167 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3860e0d4-19fc-4b54-a518-83df71e0b579 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:24.054867 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3860e0d4-19fc-4b54-a518-83df71e0b579 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:24.055324 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3860e0d4-19fc-4b54-a518-83df71e0b579 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:24.055753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3860e0d4-19fc-4b54-a518-83df71e0b579 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:24.320037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3860e0d4-19fc-4b54-a518-83df71e0b579 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "POST /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287237 Oct 06 11:22:24.320639 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 628/1248] 10.222.0.52 () {60 vars in 1323 bytes} [Thu Oct 6 11:22:24 2022] POST /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:31.951478 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-effb0c48-0503-49a1-8ac3-24f38471ac91 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:31.952173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-effb0c48-0503-49a1-8ac3-24f38471ac91 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:31.958383 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effb0c48-0503-49a1-8ac3-24f38471ac91 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:31.958855 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effb0c48-0503-49a1-8ac3-24f38471ac91 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:31.959288 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effb0c48-0503-49a1-8ac3-24f38471ac91 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:31.960012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effb0c48-0503-49a1-8ac3-24f38471ac91 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:31.960461 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effb0c48-0503-49a1-8ac3-24f38471ac91 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:31.960882 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effb0c48-0503-49a1-8ac3-24f38471ac91 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:32.040784 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-effb0c48-0503-49a1-8ac3-24f38471ac91 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lazy-loading 'services' on Instance uuid 6cd61e55-b590-41ff-ba2c-d87038bae7cc {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 11:22:32.115382 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-effb0c48-0503-49a1-8ac3-24f38471ac91 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-volume_attachments/e031a32e-9167-4ec1-b1e4-bf476b6dbd4c" status: 202 len: 0 microversion: 2.1 time: 0.167570 Oct 06 11:22:32.115997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 621/1249] 10.222.0.52 () {58 vars in 1416 bytes} [Thu Oct 6 11:22:31 2022] DELETE /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-volume_attachments/e031a32e-9167-4ec1-b1e4-bf476b6dbd4c => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:22:32.125387 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-522c3b1e-3d34-481f-868f-55fc2c3c73a3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:32.127913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-522c3b1e-3d34-481f-868f-55fc2c3c73a3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:32.134239 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-522c3b1e-3d34-481f-868f-55fc2c3c73a3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:32.134724 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-522c3b1e-3d34-481f-868f-55fc2c3c73a3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:32.135172 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-522c3b1e-3d34-481f-868f-55fc2c3c73a3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:32.135909 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-522c3b1e-3d34-481f-868f-55fc2c3c73a3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:32.136372 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-522c3b1e-3d34-481f-868f-55fc2c3c73a3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:32.136802 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-522c3b1e-3d34-481f-868f-55fc2c3c73a3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:32.168099 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-522c3b1e-3d34-481f-868f-55fc2c3c73a3 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 Oct 06 11:22:32.168667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 629/1250] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:22:32 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:33.182716 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03e28c4c-edc9-4c12-b7c7-d89172f7ff08 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:33.185083 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-03e28c4c-edc9-4c12-b7c7-d89172f7ff08 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:33.191173 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e28c4c-edc9-4c12-b7c7-d89172f7ff08 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:33.192371 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e28c4c-edc9-4c12-b7c7-d89172f7ff08 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:33.192857 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e28c4c-edc9-4c12-b7c7-d89172f7ff08 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:33.193549 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e28c4c-edc9-4c12-b7c7-d89172f7ff08 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:33.194002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e28c4c-edc9-4c12-b7c7-d89172f7ff08 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:33.194423 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e28c4c-edc9-4c12-b7c7-d89172f7ff08 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:33.224072 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-03e28c4c-edc9-4c12-b7c7-d89172f7ff08 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046079 Oct 06 11:22:33.224973 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 622/1251] 10.222.0.52 () {58 vars in 1302 bytes} [Thu Oct 6 11:22:33 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 11:22:33.291309 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38f8e624-e30d-4794-b91a-f52b0eb9b460 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:33.291883 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38f8e624-e30d-4794-b91a-f52b0eb9b460 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:33.298386 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38f8e624-e30d-4794-b91a-f52b0eb9b460 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:33.298885 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38f8e624-e30d-4794-b91a-f52b0eb9b460 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:33.299326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38f8e624-e30d-4794-b91a-f52b0eb9b460 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:33.300061 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38f8e624-e30d-4794-b91a-f52b0eb9b460 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:33.300522 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38f8e624-e30d-4794-b91a-f52b0eb9b460 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:33.301461 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38f8e624-e30d-4794-b91a-f52b0eb9b460 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:33.327648 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38f8e624-e30d-4794-b91a-f52b0eb9b460 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:22:33.405704 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38f8e624-e30d-4794-b91a-f52b0eb9b460 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 204 len: 0 microversion: 2.1 time: 0.118012 Oct 06 11:22:33.406435 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 630/1252] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:22:33 2022] DELETE /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:22:33.414536 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5a932ab-e868-41d7-ab6d-d556cfb607cb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:33.415146 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5a932ab-e868-41d7-ab6d-d556cfb607cb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:33.420977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5a932ab-e868-41d7-ab6d-d556cfb607cb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:33.421465 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5a932ab-e868-41d7-ab6d-d556cfb607cb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:33.421882 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5a932ab-e868-41d7-ab6d-d556cfb607cb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:33.422559 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5a932ab-e868-41d7-ab6d-d556cfb607cb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:33.423009 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5a932ab-e868-41d7-ab6d-d556cfb607cb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:33.423426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5a932ab-e868-41d7-ab6d-d556cfb607cb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:33.558056 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5a932ab-e868-41d7-ab6d-d556cfb607cb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:22:33.565717 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5a932ab-e868-41d7-ab6d-d556cfb607cb tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1681 microversion: 2.1 time: 0.155047 Oct 06 11:22:33.566282 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 623/1253] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:22:33 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:22:34.589185 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0eaad65-c6c8-479a-bf40-9532e0435275 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:34.589894 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0eaad65-c6c8-479a-bf40-9532e0435275 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:34.596383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0eaad65-c6c8-479a-bf40-9532e0435275 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:34.596873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0eaad65-c6c8-479a-bf40-9532e0435275 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:34.597313 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0eaad65-c6c8-479a-bf40-9532e0435275 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:34.598098 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0eaad65-c6c8-479a-bf40-9532e0435275 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:34.598557 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0eaad65-c6c8-479a-bf40-9532e0435275 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:34.598984 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0eaad65-c6c8-479a-bf40-9532e0435275 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:34.731060 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0eaad65-c6c8-479a-bf40-9532e0435275 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:22:34.739264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0eaad65-c6c8-479a-bf40-9532e0435275 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1681 microversion: 2.1 time: 0.153841 Oct 06 11:22:34.739846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 631/1254] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:22:34 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:22:35.762589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-00535121-0ceb-41d6-9af8-485c27b1b064 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:35.763311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-00535121-0ceb-41d6-9af8-485c27b1b064 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:35.769672 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00535121-0ceb-41d6-9af8-485c27b1b064 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:35.770901 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00535121-0ceb-41d6-9af8-485c27b1b064 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:35.771343 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00535121-0ceb-41d6-9af8-485c27b1b064 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:35.772328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00535121-0ceb-41d6-9af8-485c27b1b064 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:35.772783 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00535121-0ceb-41d6-9af8-485c27b1b064 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:35.773207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00535121-0ceb-41d6-9af8-485c27b1b064 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:35.908677 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-00535121-0ceb-41d6-9af8-485c27b1b064 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad5a3ee5ab545e2893d4f6365f8f939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d69675576dc4c7fa5cede0f99db8e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:22:35.916632 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-00535121-0ceb-41d6-9af8-485c27b1b064 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 200 len: 1681 microversion: 2.1 time: 0.157895 Oct 06 11:22:35.917204 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 624/1255] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:22:35 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:22:36.294021 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-266f291f-ac1b-42a1-860f-516567f20681 req-7cec985d-5257-4b52-9f3c-8bce1b610fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd61e55-b590-41ff-ba2c-d87038bae7cc", "name": "network-vif-deleted", "tag": "9f625844-0348-4f62-9cc9-f14396f34f9d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:22:36.304511 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-266f291f-ac1b-42a1-860f-516567f20681 req-7cec985d-5257-4b52-9f3c-8bce1b610fa9 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:36.304990 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-266f291f-ac1b-42a1-860f-516567f20681 req-7cec985d-5257-4b52-9f3c-8bce1b610fa9 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:36.305421 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-266f291f-ac1b-42a1-860f-516567f20681 req-7cec985d-5257-4b52-9f3c-8bce1b610fa9 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:36.319490 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-266f291f-ac1b-42a1-860f-516567f20681 req-7cec985d-5257-4b52-9f3c-8bce1b610fa9 service nova] Creating event network-vif-deleted:9f625844-0348-4f62-9cc9-f14396f34f9d for instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc on hv-cinder-86020 Oct 06 11:22:36.326484 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-266f291f-ac1b-42a1-860f-516567f20681 req-7cec985d-5257-4b52-9f3c-8bce1b610fa9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035659 Oct 06 11:22:36.327738 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 632/1256] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:36.941313 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:36.943641 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:36.950373 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:36.951137 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:36.951767 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:36.952676 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:36.953291 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:36.954319 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:36.970250 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc HTTP/1.1 Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:22:36.971977 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:36.974162 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '6cd61e55-b590-41ff-ba2c-d87038bae7cc'} Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:36.975488 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:36.976997 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:36.978581 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:36.978581 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b4069a1-c645-492e-9d97-10fc86b8e8cd tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 404 len: 111 microversion: 2.1 time: 0.036764 Oct 06 11:22:36.978581 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 625/1257] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:22:36 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:36.982888 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35dc57dd-725f-47f6-9e64-409e82523392 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '.version_select at 0x7f92aa738f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:37.002579 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35dc57dd-725f-47f6-9e64-409e82523392 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213001886" status: 202 len: 0 microversion: 2.1 time: 0.023786 Oct 06 11:22:37.003159 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 633/1258] 10.222.0.52 () {58 vars in 1221 bytes} [Thu Oct 6 11:22:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213001886 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:22:38.994726 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:38.995232 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:39.001612 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:39.002099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:39.002543 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:39.003238 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:39.003694 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:39.004781 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:39.017989 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc HTTP/1.1 Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:22:39.019518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:39.022191 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '6cd61e55-b590-41ff-ba2c-d87038bae7cc'} Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:39.023046 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:39.024740 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:39.026425 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:39.026425 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0382b33c-41e3-4279-985b-2651f2682ea1 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 404 len: 111 microversion: 2.1 time: 0.030791 Oct 06 11:22:39.026425 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 626/1259] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:22:38 2022] DELETE /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:39.030098 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:39.030880 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 6cd61e55-b590-41ff-ba2c-d87038bae7cc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:39.038080 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:39.038596 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:39.039035 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:39.039726 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:39.040213 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:39.040640 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:39.053793 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc HTTP/1.1 Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:22:39.055371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:39.057135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '6cd61e55-b590-41ff-ba2c-d87038bae7cc'} Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:39.058135 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. Oct 06 11:22:39.059753 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:39.061227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance 6cd61e55-b590-41ff-ba2c-d87038bae7cc could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:39.061227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-600b6c59-682a-4457-843f-48ed95bd0d0e tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc" status: 404 len: 111 microversion: 2.1 time: 0.030611 Oct 06 11:22:39.061227 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 634/1260] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:22:39 2022] GET /compute/v2.1/servers/6cd61e55-b590-41ff-ba2c-d87038bae7cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:40.199643 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:40.200205 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:40.206505 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:40.206982 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:40.208262 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:40.208973 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:40.209427 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:40.209854 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:40.223012 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 HTTP/1.1 Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:22:40.224563 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:22:40.226265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '605e2ba5-ae23-430e-a8a5-439650222ad4'} Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:40.227426 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:22:40.229106 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.230721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:40.230721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-104fa981-d3d3-4f50-bc35-97fb11634a46 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 404 len: 111 microversion: 2.1 time: 0.030168 Oct 06 11:22:40.230721 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 627/1261] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:22:40 2022] DELETE /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:40.235225 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:40.235859 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 605e2ba5-ae23-430e-a8a5-439650222ad4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:40.242386 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:40.242890 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:40.243322 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:40.244037 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:40.244487 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:40.244908 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:40.258600 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 HTTP/1.1 Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:22:40.260136 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:22:40.261901 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '605e2ba5-ae23-430e-a8a5-439650222ad4'} Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:40.262759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. Oct 06 11:22:40.264232 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.265456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance 605e2ba5-ae23-430e-a8a5-439650222ad4 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:40.265456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b497db7-9514-4e5d-b1bb-369bebcdd14c tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4" status: 404 len: 111 microversion: 2.1 time: 0.030242 Oct 06 11:22:40.265456 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 635/1262] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:22:40 2022] GET /compute/v2.1/servers/605e2ba5-ae23-430e-a8a5-439650222ad4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:40.270602 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:40.271132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:40.277285 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:40.277764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:40.278198 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:40.278886 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:40.279341 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:40.279767 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:40.292987 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 HTTP/1.1 Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:22:40.294522 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:22:40.296253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '65604ed1-1c1e-4050-b0f1-821dcd37a862'} Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:40.297156 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:22:40.298509 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.299921 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:40.299921 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-87b86ced-3659-4364-af2d-306373d944c0 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 404 len: 111 microversion: 2.1 time: 0.029765 Oct 06 11:22:40.299921 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 628/1263] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:22:40 2022] DELETE /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:40.304157 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:40.304768 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: 65604ed1-1c1e-4050-b0f1-821dcd37a862] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:40.310536 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:40.311011 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:40.311442 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:40.312165 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:40.312616 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:40.313039 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:40.326807 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 HTTP/1.1 Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:22:40.328339 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:22:40.330427 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '65604ed1-1c1e-4050-b0f1-821dcd37a862'} Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:40.331383 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. Oct 06 11:22:40.333560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:40.335005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance 65604ed1-1c1e-4050-b0f1-821dcd37a862 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:40.335005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e505fc3-5db8-42b6-9759-d50af5555b14 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862" status: 404 len: 111 microversion: 2.1 time: 0.029377 Oct 06 11:22:40.335005 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 636/1264] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:22:40 2022] GET /compute/v2.1/servers/65604ed1-1c1e-4050-b0f1-821dcd37a862 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:41.469328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:41.469848 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:41.476925 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:41.477405 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:41.477839 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:41.478526 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:41.478975 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:41.479395 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:41.492579 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb HTTP/1.1 Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:22:41.494107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:22:41.495919 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': 'e437667e-27e0-4c28-8bbd-206763b7d3bb'} Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:41.496862 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:22:41.498434 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:41.500084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:41.500084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e9c59456-ec00-4930-befa-6a11da2d3257 tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 404 len: 111 microversion: 2.1 time: 0.029933 Oct 06 11:22:41.500084 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 629/1265] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:22:41 2022] DELETE /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:41.503873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:41.504937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] [instance: e437667e-27e0-4c28-8bbd-206763b7d3bb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:22:41.511238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:41.511722 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:41.512205 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:41.512897 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:22:41.513351 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:22:41.513776 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:22:41.528063 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] HTTP exception thrown: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Request method failure captured: Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb HTTP/1.1 Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjVmjdj1H_ht9XkPLmXNuWMlKjFO8am2ok6ePpotgmoQqlZY0bVTiniWWpQYXl3MuZwuJEkT-CXiWNGk9n9npQcbQfEs2r3lB_O0oAAZ0VcZBM-_uVFtuAc9z_Ytqro8FCtictUjDnfHFOtzH4bHol2ltwKNxUInrZemmN5mqwjxuE Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:22:41.529560 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d69675576dc4c7fa5cede0f99db8e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5d69675576dc4c7fa5cede0f99db8e32 Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1396599542 Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: 4ad5a3ee5ab545e2893d4f6365f8f939 Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1396599542-project Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:22:41.531410 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': 'e437667e-27e0-4c28-8bbd-206763b7d3bb'} Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:41.532364 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. Oct 06 11:22:41.533743 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:41.534965 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] Returning 404 to user: Instance e437667e-27e0-4c28-8bbd-206763b7d3bb could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:41.534965 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1aea6a14-ddb0-49e8-8171-54c006c6bdec tempest-AttachVolumeNegativeTest-1396599542 tempest-AttachVolumeNegativeTest-1396599542-project] 10.222.0.52 "GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb" status: 404 len: 111 microversion: 2.1 time: 0.030911 Oct 06 11:22:41.534965 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 637/1266] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:22:41 2022] GET /compute/v2.1/servers/e437667e-27e0-4c28-8bbd-206763b7d3bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:45.711711 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf09762b-2e25-4d1f-a642-961d60d6626d tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Action: 'create', calling method: .version_select at 0x7f92a70aef70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-351482391"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:22:45.999582 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf09762b-2e25-4d1f-a642-961d60d6626d tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.403422 Oct 06 11:22:46.000745 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 630/1267] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Oct 6 11:22:45 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 06 11:22:46.014312 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1036d6a8-149f-4230-972b-06eb920b3e57 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6dec940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:46.069873 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1036d6a8-149f-4230-972b-06eb920b3e57 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2" status: 200 len: 344 microversion: 2.1 time: 0.059862 Oct 06 11:22:46.070468 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 638/1268] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:22:46 2022] GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:47.083881 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-54777cf8-c154-43ae-959a-b28635c556b5 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6eb3310>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:47.130567 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-54777cf8-c154-43ae-959a-b28635c556b5 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2" status: 200 len: 345 microversion: 2.1 time: 0.050903 Oct 06 11:22:47.131121 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 631/1269] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:22:47 2022] GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:47.144356 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ae64705f-ff5b-45eb-af41-2e4e59acdaa7 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Action: 'create', calling method: .version_select at 0x7f92a6e821f0>, body: {"snapshot": {"volume_id": "623ab31c-a998-4ddc-b4d5-1e75c546fdf2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1759258584"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:22:47.294479 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ae64705f-ff5b-45eb-af41-2e4e59acdaa7 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.154390 Oct 06 11:22:47.295148 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 639/1270] 10.222.0.52 () {60 vars in 1162 bytes} [Thu Oct 6 11:22:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:47.306518 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bb158a1a-3949-42ee-8213-9befdcc073f2 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a7244e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:47.336432 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bb158a1a-3949-42ee-8213-9befdcc073f2 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e" status: 200 len: 287 microversion: 2.1 time: 0.033637 Oct 06 11:22:47.336989 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 632/1271] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Oct 6 11:22:47 2022] GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:47.348845 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3aa3db59-5378-4fd4-9852-862491e85906 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92aa738700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:47.378147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3aa3db59-5378-4fd4-9852-862491e85906 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033678 Oct 06 11:22:47.378702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 640/1272] 10.222.0.52 () {58 vars in 1140 bytes} [Thu Oct 6 11:22:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:47.390304 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eba143c0-649a-4e0a-af2e-2b6ccbd47d15 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a70aee50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:47.420560 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eba143c0-649a-4e0a-af2e-2b6ccbd47d15 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e" status: 200 len: 287 microversion: 2.1 time: 0.033982 Oct 06 11:22:47.421121 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 633/1273] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Oct 6 11:22:47 2022] GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:48.433759 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5550763-71ab-4700-9210-0e4d279dfd4c tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6db8550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:48.464995 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5550763-71ab-4700-9210-0e4d279dfd4c tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e" status: 200 len: 287 microversion: 2.1 time: 0.035450 Oct 06 11:22:48.465554 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 641/1274] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Oct 6 11:22:48 2022] GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:49.479002 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c4711c6-7ffe-4ab7-9536-aba3dba8ab64 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6faf790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:49.509207 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c4711c6-7ffe-4ab7-9536-aba3dba8ab64 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e" status: 200 len: 287 microversion: 2.1 time: 0.034504 Oct 06 11:22:49.509758 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 634/1275] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Oct 6 11:22:49 2022] GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:50.523176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b733895-c644-4b39-b217-25ad286af3f8 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6fb9430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:50.552840 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b733895-c644-4b39-b217-25ad286af3f8 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e" status: 200 len: 287 microversion: 2.1 time: 0.034728 Oct 06 11:22:50.553408 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 642/1276] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Oct 6 11:22:50 2022] GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:51.563101 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=20 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:22:51.563786 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:22:51.568711 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2db19691-f60d-4f95-aeed-739bd74ef71a tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a70ae940>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:51.598494 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2db19691-f60d-4f95-aeed-739bd74ef71a tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e" status: 200 len: 287 microversion: 2.1 time: 0.036044 Oct 06 11:22:51.599074 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 635/1277] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Oct 6 11:22:51 2022] GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:52.608178 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:22:52.608956 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:22:52.614341 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c853e20-8f30-4f95-bcd7-5c1ba4c0b424 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6db81f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:52.645354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c853e20-8f30-4f95-bcd7-5c1ba4c0b424 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e" status: 200 len: 288 microversion: 2.1 time: 0.037920 Oct 06 11:22:52.645909 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 643/1278] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Oct 6 11:22:52 2022] GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:52.657594 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da4a4896-2696-4961-8d97-5fa7f7039f02 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a708edc0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:52.715132 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da4a4896-2696-4961-8d97-5fa7f7039f02 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e" status: 202 len: 0 microversion: 2.1 time: 0.061735 Oct 06 11:22:52.715702 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 636/1279] 10.222.0.52 () {58 vars in 1254 bytes} [Thu Oct 6 11:22:52 2022] DELETE /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:22:52.724093 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-331a6355-68b8-46c3-a2b2-afe0a17ef6f1 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6fa53a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:52.753567 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-331a6355-68b8-46c3-a2b2-afe0a17ef6f1 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e" status: 200 len: 287 microversion: 2.1 time: 0.033524 Oct 06 11:22:52.754745 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 644/1280] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Oct 6 11:22:52 2022] GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:53.767320 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61568f16-36e8-42ce-8bb1-4b0702a4d905 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6ce85e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:53.792890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-61568f16-36e8-42ce-8bb1-4b0702a4d905 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] HTTP exception thrown: Snapshot 6eb6a89c-bae4-4f9a-ac6c-55052bfe275e could not be found. Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61568f16-36e8-42ce-8bb1-4b0702a4d905 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Request method failure captured: Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e HTTP/1.1 Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrqF_S1_wssn1omN7AWfDGat7V7qWCkFRn98vItArmqC9tf0f_phbEBm2yd_cT1B4NyOO7FfaYWC6oRafuy4ThpBFPIyXAi1OwLaDDuLgmkdWwRpDuOGs7kb9FpdjZV7Upka7rDRUewbt2oc5Pl-vzZnSZ8awEgWR_HzQSelQxpdSKA Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 672e8372532f48379b67b4ba4609a351 Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:22:53.795043 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/672e8372532f48379b67b4ba4609a351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/672e8372532f48379b67b4ba4609a351"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/672e8372532f48379b67b4ba4609a351"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_672e8372532f48379b67b4ba4609a351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 672e8372532f48379b67b4ba4609a351 Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-VolumesSnapshotsTestJSON-1045856421-project Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: d19ef299f7ef495c83681e624fa0c314 Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045856421-project Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Snapshot 6eb6a89c-bae4-4f9a-ac6c-55052bfe275e could not be found. Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '6eb6a89c-bae4-4f9a-ac6c-55052bfe275e'} Oct 06 11:22:53.796843 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6eb6a89c-bae4-4f9a-ac6c-55052bfe275e could not be found. (HTTP 404) (Request-ID: req-fab8dd01-0344-41ff-af73-5a975d60a099) Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:53.798004 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 11:22:53.799499 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6eb6a89c-bae4-4f9a-ac6c-55052bfe275e could not be found. Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 06 11:22:53.801141 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6eb6a89c-bae4-4f9a-ac6c-55052bfe275e could not be found. Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6eb6a89c-bae4-4f9a-ac6c-55052bfe275e could not be found. Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61568f16-36e8-42ce-8bb1-4b0702a4d905 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Returning 404 to user: Snapshot 6eb6a89c-bae4-4f9a-ac6c-55052bfe275e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:53.803185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61568f16-36e8-42ce-8bb1-4b0702a4d905 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e" status: 404 len: 111 microversion: 2.1 time: 0.033420 Oct 06 11:22:53.804311 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 637/1281] 10.222.0.52 () {58 vars in 1251 bytes} [Thu Oct 6 11:22:53 2022] GET /compute/v2.1/os-snapshots/6eb6a89c-bae4-4f9a-ac6c-55052bfe275e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:53.805668 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d10992dd-50e3-4047-ab5f-95f31a3d10d0 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92aa738700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:53.869594 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d10992dd-50e3-4047-ab5f-95f31a3d10d0 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2" status: 202 len: 0 microversion: 2.1 time: 0.068110 Oct 06 11:22:53.870426 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 645/1282] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Oct 6 11:22:53 2022] DELETE /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 11:22:53.879168 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7490a244-1b0d-459a-98ba-4cd93dc5e8fa tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6fb3b80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:53.933413 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7490a244-1b0d-459a-98ba-4cd93dc5e8fa tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2" status: 200 len: 344 microversion: 2.1 time: 0.058532 Oct 06 11:22:53.934014 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 638/1283] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:22:53 2022] GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:22:54.948780 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62cd27ae-3f34-4906-adcb-65816587aa60 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6f98430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:54.976935 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-62cd27ae-3f34-4906-adcb-65816587aa60 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] HTTP exception thrown: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62cd27ae-3f34-4906-adcb-65816587aa60 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Request method failure captured: Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2 HTTP/1.1 Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrqF_S1_wssn1omN7AWfDGat7V7qWCkFRn98vItArmqC9tf0f_phbEBm2yd_cT1B4NyOO7FfaYWC6oRafuy4ThpBFPIyXAi1OwLaDDuLgmkdWwRpDuOGs7kb9FpdjZV7Upka7rDRUewbt2oc5Pl-vzZnSZ8awEgWR_HzQSelQxpdSKA Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 672e8372532f48379b67b4ba4609a351 Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:22:54.978937 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/672e8372532f48379b67b4ba4609a351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/672e8372532f48379b67b4ba4609a351"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/672e8372532f48379b67b4ba4609a351"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_672e8372532f48379b67b4ba4609a351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 672e8372532f48379b67b4ba4609a351 Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesSnapshotsTestJSON-1045856421-project Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: d19ef299f7ef495c83681e624fa0c314 Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045856421-project Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '623ab31c-a998-4ddc-b4d5-1e75c546fdf2'} Oct 06 11:22:54.980702 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. (HTTP 404) (Request-ID: req-e3372601-2dce-46f1-aea5-d01ccb976efc) Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:54.981667 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 11:22:54.983062 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 11:22:54.984363 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62cd27ae-3f34-4906-adcb-65816587aa60 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Returning 404 to user: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62cd27ae-3f34-4906-adcb-65816587aa60 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2" status: 404 len: 109 microversion: 2.1 time: 0.036007 Oct 06 11:22:54.986326 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 646/1284] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:22:54 2022] GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:54.994496 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73cfaaa2-e771-4633-9f7b-a53b055cd33b tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a82ccca0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:55.022733 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-73cfaaa2-e771-4633-9f7b-a53b055cd33b tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] HTTP exception thrown: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73cfaaa2-e771-4633-9f7b-a53b055cd33b tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Request method failure captured: Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2 HTTP/1.1 Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrqF_S1_wssn1omN7AWfDGat7V7qWCkFRn98vItArmqC9tf0f_phbEBm2yd_cT1B4NyOO7FfaYWC6oRafuy4ThpBFPIyXAi1OwLaDDuLgmkdWwRpDuOGs7kb9FpdjZV7Upka7rDRUewbt2oc5Pl-vzZnSZ8awEgWR_HzQSelQxpdSKA Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 672e8372532f48379b67b4ba4609a351 Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:22:55.024671 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/672e8372532f48379b67b4ba4609a351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/672e8372532f48379b67b4ba4609a351"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/672e8372532f48379b67b4ba4609a351"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_672e8372532f48379b67b4ba4609a351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 672e8372532f48379b67b4ba4609a351 Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-VolumesSnapshotsTestJSON-1045856421-project Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: d19ef299f7ef495c83681e624fa0c314 Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045856421-project Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '623ab31c-a998-4ddc-b4d5-1e75c546fdf2'} Oct 06 11:22:55.026378 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. (HTTP 404) (Request-ID: req-7fba3dad-87ca-45cb-ae7b-ea46ac1821ae) Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:55.027472 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 11:22:55.029051 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 11:22:55.030550 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73cfaaa2-e771-4633-9f7b-a53b055cd33b tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Returning 404 to user: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:55.032107 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-73cfaaa2-e771-4633-9f7b-a53b055cd33b tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2" status: 404 len: 109 microversion: 2.1 time: 0.035814 Oct 06 11:22:55.033165 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 639/1285] 10.222.0.52 () {58 vars in 1248 bytes} [Thu Oct 6 11:22:54 2022] DELETE /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:22:55.037040 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c975109-1223-4962-99e0-bda066f924d3 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Calling method '.version_select at 0x7f92a6db8280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:22:55.064419 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6c975109-1223-4962-99e0-bda066f924d3 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] HTTP exception thrown: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c975109-1223-4962-99e0-bda066f924d3 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Request method failure captured: Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2 HTTP/1.1 Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrqF_S1_wssn1omN7AWfDGat7V7qWCkFRn98vItArmqC9tf0f_phbEBm2yd_cT1B4NyOO7FfaYWC6oRafuy4ThpBFPIyXAi1OwLaDDuLgmkdWwRpDuOGs7kb9FpdjZV7Upka7rDRUewbt2oc5Pl-vzZnSZ8awEgWR_HzQSelQxpdSKA Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 672e8372532f48379b67b4ba4609a351 Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:22:55.066335 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/672e8372532f48379b67b4ba4609a351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/672e8372532f48379b67b4ba4609a351"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/672e8372532f48379b67b4ba4609a351"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_672e8372532f48379b67b4ba4609a351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 672e8372532f48379b67b4ba4609a351 Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045856421 Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesSnapshotsTestJSON-1045856421-project Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: d19ef299f7ef495c83681e624fa0c314 Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045856421-project Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '623ab31c-a998-4ddc-b4d5-1e75c546fdf2'} Oct 06 11:22:55.068260 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. (HTTP 404) (Request-ID: req-ce07cc5d-5674-441f-9f7c-5390738f3168) Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:55.069354 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 11:22:55.070961 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 11:22:55.072518 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c975109-1223-4962-99e0-bda066f924d3 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] Returning 404 to user: Volume 623ab31c-a998-4ddc-b4d5-1e75c546fdf2 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6c975109-1223-4962-99e0-bda066f924d3 tempest-VolumesSnapshotsTestJSON-1045856421 tempest-VolumesSnapshotsTestJSON-1045856421-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2" status: 404 len: 109 microversion: 2.1 time: 0.036342 Oct 06 11:22:55.074043 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 647/1286] 10.222.0.52 () {58 vars in 1245 bytes} [Thu Oct 6 11:22:55 2022] GET /compute/v2.1/os-volumes/623ab31c-a998-4ddc-b4d5-1e75c546fdf2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:24:07.497711 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 11:24:07.498239 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Thu Oct 6 11:24:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b (ip 10.222.0.52) !!! Oct 06 11:24:07.505547 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-048f0d10-51d8-446d-a525-2269d7dc6f7a req-44267b24-79be-44ad-a8c7-b95fe2f1c663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abc00d92-0c52-4d38-a0df-5b07f32c182b", "tag": "c4043237-0c79-48b2-8d04-310009d98d00"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:24:07.516606 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc1f8737-f8f2-413c-ac7a-e26cb97e4215 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:07.517099 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc1f8737-f8f2-413c-ac7a-e26cb97e4215 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:07.519139 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-048f0d10-51d8-446d-a525-2269d7dc6f7a req-44267b24-79be-44ad-a8c7-b95fe2f1c663 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:07.519630 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-048f0d10-51d8-446d-a525-2269d7dc6f7a req-44267b24-79be-44ad-a8c7-b95fe2f1c663 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:07.520098 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-048f0d10-51d8-446d-a525-2269d7dc6f7a req-44267b24-79be-44ad-a8c7-b95fe2f1c663 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:07.526695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1f8737-f8f2-413c-ac7a-e26cb97e4215 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:07.527187 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1f8737-f8f2-413c-ac7a-e26cb97e4215 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:07.527636 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1f8737-f8f2-413c-ac7a-e26cb97e4215 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:07.528356 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1f8737-f8f2-413c-ac7a-e26cb97e4215 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:07.528806 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1f8737-f8f2-413c-ac7a-e26cb97e4215 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:07.529228 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1f8737-f8f2-413c-ac7a-e26cb97e4215 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:07.532445 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-048f0d10-51d8-446d-a525-2269d7dc6f7a req-44267b24-79be-44ad-a8c7-b95fe2f1c663 service nova] Creating event network-changed:c4043237-0c79-48b2-8d04-310009d98d00 for instance abc00d92-0c52-4d38-a0df-5b07f32c182b on hv-cinder-86020 Oct 06 11:24:07.538068 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-048f0d10-51d8-446d-a525-2269d7dc6f7a req-44267b24-79be-44ad-a8c7-b95fe2f1c663 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038437 Oct 06 11:24:07.538902 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 648/1287] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:24:07.555728 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc1f8737-f8f2-413c-ac7a-e26cb97e4215 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:24:07.639726 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc1f8737-f8f2-413c-ac7a-e26cb97e4215 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "DELETE /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 204 len: 0 microversion: 2.1 time: 0.144737 Oct 06 11:24:07.643764 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 640/1288] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:24:07 2022] DELETE /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:24:07.649504 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ef70433-9bc5-41ac-a432-b9131f4dad68 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:07.650214 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ef70433-9bc5-41ac-a432-b9131f4dad68 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:07.656594 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef70433-9bc5-41ac-a432-b9131f4dad68 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:07.657088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef70433-9bc5-41ac-a432-b9131f4dad68 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:07.657533 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef70433-9bc5-41ac-a432-b9131f4dad68 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:07.658238 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef70433-9bc5-41ac-a432-b9131f4dad68 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:07.658698 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef70433-9bc5-41ac-a432-b9131f4dad68 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:07.659126 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef70433-9bc5-41ac-a432-b9131f4dad68 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:07.982913 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ef70433-9bc5-41ac-a432-b9131f4dad68 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:24:07.990879 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ef70433-9bc5-41ac-a432-b9131f4dad68 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1577 microversion: 2.1 time: 0.345806 Oct 06 11:24:07.991467 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 649/1289] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:24:07 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1577 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 11:24:09.015644 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb6c955f-3733-476c-9d68-b2625b8da153 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:09.016406 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb6c955f-3733-476c-9d68-b2625b8da153 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:09.022993 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb6c955f-3733-476c-9d68-b2625b8da153 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:09.023477 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb6c955f-3733-476c-9d68-b2625b8da153 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:09.023943 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb6c955f-3733-476c-9d68-b2625b8da153 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:09.024679 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb6c955f-3733-476c-9d68-b2625b8da153 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:09.025134 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb6c955f-3733-476c-9d68-b2625b8da153 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:09.025561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb6c955f-3733-476c-9d68-b2625b8da153 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:09.221301 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb6c955f-3733-476c-9d68-b2625b8da153 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:24:09.229695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb6c955f-3733-476c-9d68-b2625b8da153 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1577 microversion: 2.1 time: 0.217739 Oct 06 11:24:09.230265 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 641/1290] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:24:09 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:24:10.052900 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-31cf982a-8309-4dd1-9be3-dd57a211c0c9 req-a4a00293-1e7a-4775-9a77-c0325c57860f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc00d92-0c52-4d38-a0df-5b07f32c182b", "name": "network-vif-deleted", "tag": "c4043237-0c79-48b2-8d04-310009d98d00"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:24:10.064133 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-31cf982a-8309-4dd1-9be3-dd57a211c0c9 req-a4a00293-1e7a-4775-9a77-c0325c57860f service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:10.064623 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-31cf982a-8309-4dd1-9be3-dd57a211c0c9 req-a4a00293-1e7a-4775-9a77-c0325c57860f service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:10.065087 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-31cf982a-8309-4dd1-9be3-dd57a211c0c9 req-a4a00293-1e7a-4775-9a77-c0325c57860f service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:10.076020 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-31cf982a-8309-4dd1-9be3-dd57a211c0c9 req-a4a00293-1e7a-4775-9a77-c0325c57860f service nova] Creating event network-vif-deleted:c4043237-0c79-48b2-8d04-310009d98d00 for instance abc00d92-0c52-4d38-a0df-5b07f32c182b on hv-cinder-86020 Oct 06 11:24:10.080703 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-31cf982a-8309-4dd1-9be3-dd57a211c0c9 req-a4a00293-1e7a-4775-9a77-c0325c57860f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092002 Oct 06 11:24:10.081308 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 650/1291] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:24:10.253294 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ecee6e0-2cca-472c-b683-4d6894a97186 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:10.253941 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4ecee6e0-2cca-472c-b683-4d6894a97186 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:10.262263 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ecee6e0-2cca-472c-b683-4d6894a97186 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:10.263052 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ecee6e0-2cca-472c-b683-4d6894a97186 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:10.263507 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ecee6e0-2cca-472c-b683-4d6894a97186 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:10.264253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ecee6e0-2cca-472c-b683-4d6894a97186 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:10.264760 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ecee6e0-2cca-472c-b683-4d6894a97186 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:10.265275 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ecee6e0-2cca-472c-b683-4d6894a97186 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:10.331595 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-4ecee6e0-2cca-472c-b683-4d6894a97186 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:24:10.340016 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ecee6e0-2cca-472c-b683-4d6894a97186 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 200 len: 1225 microversion: 2.1 time: 0.090551 Oct 06 11:24:10.340602 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 642/1292] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:24:10 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:24:11.364832 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:11.365532 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: abc00d92-0c52-4d38-a0df-5b07f32c182b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:11.372314 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:11.372798 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:11.373233 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:11.373924 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:11.374375 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:11.374896 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:11.388488 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] HTTP exception thrown: Instance abc00d92-0c52-4d38-a0df-5b07f32c182b could not be found. Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Request method failure captured: Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b HTTP/1.1 Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjqcyfwMjL7orR4zRiIJTEsq55TYB8vhOBZKpWG7HJUxPMtAXrTrkQMh35rpmQ7uaAW2XOEB1QY6oPU8JvHXnOofc1D4wWZ-_-cJLJtNkwftWmqkbm8wiRoxQQLf1gO2kqkKRjdrZHxVGFuOlHq8MR8MHzpnSYBgUOc-TKvcIFbJ4M Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 0934343645484d01b9b48a40bbf0b671 Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:24:11.390109 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0934343645484d01b9b48a40bbf0b671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 0934343645484d01b9b48a40bbf0b671 Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1089288570-project Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: acf06fe641e94b5b91145ed230ac7213 Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1089288570-project Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance abc00d92-0c52-4d38-a0df-5b07f32c182b could not be found. Oct 06 11:24:11.392176 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': 'abc00d92-0c52-4d38-a0df-5b07f32c182b'} Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc00d92-0c52-4d38-a0df-5b07f32c182b could not be found. Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:24:11.393785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc00d92-0c52-4d38-a0df-5b07f32c182b could not be found. Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc00d92-0c52-4d38-a0df-5b07f32c182b could not be found. Oct 06 11:24:11.395588 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:11.397510 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Returning 404 to user: Instance abc00d92-0c52-4d38-a0df-5b07f32c182b could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:24:11.397510 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91cca24c-1716-4ffa-a211-183d64c6650c tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b" status: 404 len: 111 microversion: 2.1 time: 0.031438 Oct 06 11:24:11.397510 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 651/1293] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:24:11 2022] GET /compute/v2.1/servers/abc00d92-0c52-4d38-a0df-5b07f32c182b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:24:14.446615 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5bed6971-b457-4860-8187-5e42d60f539f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:14.449450 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a998c12c-1569-4464-8610-95bab5177b98 req-bdee83ac-00de-42a4-82fc-a1182f1b1396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d4e7b17-b1e6-4e0c-af11-16d20efb530d", "tag": "540e5da9-dcce-45db-b59c-83443ed6141e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:24:14.449911 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5bed6971-b457-4860-8187-5e42d60f539f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:14.455908 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bed6971-b457-4860-8187-5e42d60f539f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:14.456418 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bed6971-b457-4860-8187-5e42d60f539f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:14.457088 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bed6971-b457-4860-8187-5e42d60f539f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:14.457797 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bed6971-b457-4860-8187-5e42d60f539f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:14.458253 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bed6971-b457-4860-8187-5e42d60f539f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:14.458679 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bed6971-b457-4860-8187-5e42d60f539f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:14.459154 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a998c12c-1569-4464-8610-95bab5177b98 req-bdee83ac-00de-42a4-82fc-a1182f1b1396 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:14.459631 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a998c12c-1569-4464-8610-95bab5177b98 req-bdee83ac-00de-42a4-82fc-a1182f1b1396 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:14.460088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a998c12c-1569-4464-8610-95bab5177b98 req-bdee83ac-00de-42a4-82fc-a1182f1b1396 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:14.472220 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a998c12c-1569-4464-8610-95bab5177b98 req-bdee83ac-00de-42a4-82fc-a1182f1b1396 service nova] Creating event network-changed:540e5da9-dcce-45db-b59c-83443ed6141e for instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d on hv-cinder-86020 Oct 06 11:24:14.477785 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a998c12c-1569-4464-8610-95bab5177b98 req-bdee83ac-00de-42a4-82fc-a1182f1b1396 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032527 Oct 06 11:24:14.478423 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 652/1294] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:24:14.487745 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5bed6971-b457-4860-8187-5e42d60f539f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 11:24:14.569938 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5bed6971-b457-4860-8187-5e42d60f539f tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 204 len: 0 microversion: 2.1 time: 0.126575 Oct 06 11:24:14.570422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 643/1295] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:24:14 2022] DELETE /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 11:24:14.580571 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13812cd7-b53e-4f54-8c22-f6c46992fbdc tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:14.581680 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13812cd7-b53e-4f54-8c22-f6c46992fbdc tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:14.587938 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13812cd7-b53e-4f54-8c22-f6c46992fbdc tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:14.588489 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13812cd7-b53e-4f54-8c22-f6c46992fbdc tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:14.589264 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13812cd7-b53e-4f54-8c22-f6c46992fbdc tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:14.589627 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13812cd7-b53e-4f54-8c22-f6c46992fbdc tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:14.590088 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13812cd7-b53e-4f54-8c22-f6c46992fbdc tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:14.590517 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13812cd7-b53e-4f54-8c22-f6c46992fbdc tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:14.725559 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-13812cd7-b53e-4f54-8c22-f6c46992fbdc tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:24:14.733984 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13812cd7-b53e-4f54-8c22-f6c46992fbdc tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1578 microversion: 2.1 time: 0.158978 Oct 06 11:24:14.734573 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 653/1296] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:24:14 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:24:15.759048 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10db28fa-ce2a-4884-9a1b-d7a45fda64bf tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:15.759753 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10db28fa-ce2a-4884-9a1b-d7a45fda64bf tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:15.766707 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10db28fa-ce2a-4884-9a1b-d7a45fda64bf tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:15.767184 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10db28fa-ce2a-4884-9a1b-d7a45fda64bf tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:15.767617 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10db28fa-ce2a-4884-9a1b-d7a45fda64bf tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:15.768335 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10db28fa-ce2a-4884-9a1b-d7a45fda64bf tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:15.768782 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10db28fa-ce2a-4884-9a1b-d7a45fda64bf tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:15.769202 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10db28fa-ce2a-4884-9a1b-d7a45fda64bf tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:15.898245 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.policy [None req-10db28fa-ce2a-4884-9a1b-d7a45fda64bf tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:24:15.905995 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10db28fa-ce2a-4884-9a1b-d7a45fda64bf tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1578 microversion: 2.1 time: 0.151180 Oct 06 11:24:15.906561 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 644/1297] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:24:15 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:24:16.929534 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b039ac0-90f1-4c06-89df-3ac11224f8cb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:16.930147 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b039ac0-90f1-4c06-89df-3ac11224f8cb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:16.937838 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b039ac0-90f1-4c06-89df-3ac11224f8cb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:16.938398 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b039ac0-90f1-4c06-89df-3ac11224f8cb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:16.938846 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b039ac0-90f1-4c06-89df-3ac11224f8cb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:16.939562 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b039ac0-90f1-4c06-89df-3ac11224f8cb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:16.940077 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b039ac0-90f1-4c06-89df-3ac11224f8cb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:16.940537 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b039ac0-90f1-4c06-89df-3ac11224f8cb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:17.031590 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b039ac0-90f1-4c06-89df-3ac11224f8cb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf06fe641e94b5b91145ed230ac7213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934343645484d01b9b48a40bbf0b671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 11:24:17.039564 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b039ac0-90f1-4c06-89df-3ac11224f8cb tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 200 len: 1393 microversion: 2.1 time: 0.114433 Oct 06 11:24:17.040296 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 654/1298] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:24:16 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 1393 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 11:24:17.046278 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-13655e8e-922f-4600-8e42-2d7dc34c977b req-352654e5-5acd-471d-8afe-d52e9c518f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4e7b17-b1e6-4e0c-af11-16d20efb530d", "name": "network-vif-deleted", "tag": "540e5da9-dcce-45db-b59c-83443ed6141e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 11:24:17.058904 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13655e8e-922f-4600-8e42-2d7dc34c977b req-352654e5-5acd-471d-8afe-d52e9c518f24 service nova] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:17.059394 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13655e8e-922f-4600-8e42-2d7dc34c977b req-352654e5-5acd-471d-8afe-d52e9c518f24 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:17.059864 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13655e8e-922f-4600-8e42-2d7dc34c977b req-352654e5-5acd-471d-8afe-d52e9c518f24 service nova] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:17.076401 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-13655e8e-922f-4600-8e42-2d7dc34c977b req-352654e5-5acd-471d-8afe-d52e9c518f24 service nova] Creating event network-vif-deleted:540e5da9-dcce-45db-b59c-83443ed6141e for instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d on hv-cinder-86020 Oct 06 11:24:17.081695 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-13655e8e-922f-4600-8e42-2d7dc34c977b req-352654e5-5acd-471d-8afe-d52e9c518f24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040050 Oct 06 11:24:17.082292 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 645/1299] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Oct 6 11:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 11:24:18.064767 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:18.065322 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 1d4e7b17-b1e6-4e0c-af11-16d20efb530d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:18.071799 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:18.072323 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:18.072772 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:18.074118 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:18.074583 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:18.075018 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:18.087970 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] HTTP exception thrown: Instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d could not be found. Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Request method failure captured: Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d HTTP/1.1 Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjqcyfwMjL7orR4zRiIJTEsq55TYB8vhOBZKpWG7HJUxPMtAXrTrkQMh35rpmQ7uaAW2XOEB1QY6oPU8JvHXnOofc1D4wWZ-_-cJLJtNkwftWmqkbm8wiRoxQQLf1gO2kqkKRjdrZHxVGFuOlHq8MR8MHzpnSYBgUOc-TKvcIFbJ4M Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 0934343645484d01b9b48a40bbf0b671 Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:24:18.089934 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0934343645484d01b9b48a40bbf0b671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 0934343645484d01b9b48a40bbf0b671 Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1089288570-project Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: acf06fe641e94b5b91145ed230ac7213 Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1089288570-project Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d could not be found. Oct 06 11:24:18.091699 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '1d4e7b17-b1e6-4e0c-af11-16d20efb530d'} Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d could not be found. Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:24:18.092760 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d could not be found. Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d could not be found. Oct 06 11:24:18.094392 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.095877 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Returning 404 to user: Instance 1d4e7b17-b1e6-4e0c-af11-16d20efb530d could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:24:18.095877 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f623d3d4-f4fe-4fcc-a249-28cdafe8fd4e tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d" status: 404 len: 111 microversion: 2.1 time: 0.030649 Oct 06 11:24:18.095877 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 655/1300] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:24:18 2022] GET /compute/v2.1/servers/1d4e7b17-b1e6-4e0c-af11-16d20efb530d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:24:18.540181 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:18.540763 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:18.547817 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:18.548329 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:18.548761 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:18.549446 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:18.549890 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:18.550309 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:18.563789 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] HTTP exception thrown: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Request method failure captured: Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de HTTP/1.1 Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept: application/json Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Accept-Encoding: identity Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Connection: close Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Length: 0 Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Content-Type: application/json Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Host: 10.222.0.52 Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjPrjqcyfwMjL7orR4zRiIJTEsq55TYB8vhOBZKpWG7HJUxPMtAXrTrkQMh35rpmQ7uaAW2XOEB1QY6oPU8JvHXnOofc1D4wWZ-_-cJLJtNkwftWmqkbm8wiRoxQQLf1gO2kqkKRjdrZHxVGFuOlHq8MR8MHzpnSYBgUOc-TKvcIFbJ4M Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Id: None Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Domain-Name: None Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Id: 0934343645484d01b9b48a40bbf0b671 Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Project-Name: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Role: reader,member Oct 06 11:24:18.565422 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Roles: reader,member Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0934343645484d01b9b48a40bbf0b671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Id: 0934343645484d01b9b48a40bbf0b671 Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User: tempest-TestVolumeBootPattern-1089288570-project Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Id: acf06fe641e94b5b91145ed230ac7213 Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: X-User-Name: tempest-TestVolumeBootPattern-1089288570-project Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: method: > Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: exception: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:24:18.567185 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: action_args: {'id': '847a7542-8658-4e05-85d3-98b8ceb6c9de'} Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:24:18.568153 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:24:18.569589 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.571172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Returning 404 to user: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:24:18.571172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c099e9c-0f43-4a8f-b4b0-bbe092e5f744 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "DELETE /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 404 len: 111 microversion: 2.1 time: 0.030797 Oct 06 11:24:18.571172 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 646/1301] 10.222.0.52 () {58 vars in 1239 bytes} [Thu Oct 6 11:24:18 2022] DELETE /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:24:18.575371 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:18.576017 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] [instance: 847a7542-8658-4e05-85d3-98b8ceb6c9de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 11:24:18.581875 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:18.582358 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:18.582793 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:18.583482 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Acquiring lock "64583f48-9147-4152-987f-d1b239ba1ce3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 11:24:18.583967 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 11:24:18.584391 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Lock "64583f48-9147-4152-987f-d1b239ba1ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 11:24:18.599737 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] HTTP exception thrown: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Request method failure captured: Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de HTTP/1.1 Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept: application/json Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Connection: close Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Length: 0 Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Content-Type: application/json Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Host: 10.222.0.52 Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjPrjqcyfwMjL7orR4zRiIJTEsq55TYB8vhOBZKpWG7HJUxPMtAXrTrkQMh35rpmQ7uaAW2XOEB1QY6oPU8JvHXnOofc1D4wWZ-_-cJLJtNkwftWmqkbm8wiRoxQQLf1gO2kqkKRjdrZHxVGFuOlHq8MR8MHzpnSYBgUOc-TKvcIFbJ4M Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Id: 0934343645484d01b9b48a40bbf0b671 Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Role: reader,member Oct 06 11:24:18.601292 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0934343645484d01b9b48a40bbf0b671"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0934343645484d01b9b48a40bbf0b671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 0934343645484d01b9b48a40bbf0b671 Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1089288570 Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1089288570-project Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Id: acf06fe641e94b5b91145ed230ac7213 Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1089288570-project Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: method: > Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: exception: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:24:18.603092 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: action_args: {'id': '847a7542-8658-4e05-85d3-98b8ceb6c9de'} Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 11:24:18.604112 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. Oct 06 11:24:18.606624 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 06 11:24:18.608265 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Returning 404 to user: Instance 847a7542-8658-4e05-85d3-98b8ceb6c9de could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 11:24:18.608265 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-66737ff2-8cdd-4724-b03e-7c683277e005 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de" status: 404 len: 111 microversion: 2.1 time: 0.031083 Oct 06 11:24:18.608265 dv-cinder-860209-2-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 656/1302] 10.222.0.52 () {58 vars in 1236 bytes} [Thu Oct 6 11:24:18 2022] GET /compute/v2.1/servers/847a7542-8658-4e05-85d3-98b8ceb6c9de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 11:24:19.896328 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5424db6-b3d2-4822-b625-921f3624a7c7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] Calling method '.version_select at 0x7f92a6d303a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 11:24:19.922548 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5424db6-b3d2-4822-b625-921f3624a7c7 tempest-TestVolumeBootPattern-1089288570 tempest-TestVolumeBootPattern-1089288570-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1768988469" status: 202 len: 0 microversion: 2.1 time: 0.029909 Oct 06 11:24:19.923324 dv-cinder-860209-2-iscsi devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 647/1303] 10.222.0.52 () {58 vars in 1263 bytes} [Thu Oct 6 11:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1768988469 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)